🤖 Overview

teezirbot is a legitimate web crawler operated by Teezir, a company specializing in search engine optimization (SEO) monitoring and website analytics. Its primary purpose is to systematically scan websites to collect data on page structure, link profiles, and content quality, which feeds into Teezir’s commercial platform that provides site audits, backlink analysis, and performance benchmarking for webmasters and marketers. The crawler was first publicly documented on Teezir’s official website around 2020 and is listed in common robots.txt databases as a well-behaved bot.

🌐 Technical Behavior

The crawler uses standard HTTP/1.1 requests with a configurable Crawl-Delay value (default 5 seconds between requests) to minimize server impact. It primarily targets HTML pages, CSS files, and JavaScript resources to render full page snapshots, but it does not download binary files like images or videos unless explicitly allowed by robots.txt. The IP ranges used by teezirbot are dynamic, but official documentation states they originate from Teezir’s cloud infrastructure hosted on AWS, with netblocks published in the ASN 14618 (Amazon Web Services) range. The bot follows canonical URLs and respects noindex meta tags, and it sends a custom header X-Teezir-Bot: true to help webmasters identify its requests.

📋 robots.txt Compliance

According to Teezir’s official bot policy page at https://teezir.com/bot, teezirbot fully honors robots.txt Disallow directives and Crawl-Delay instructions. It also supports the User-agent specific directives in robots.txt, allowing webmasters to restrict crawling of specific paths or entire sites. Independent tests by webmasters have confirmed that teezirbot does not ignore Disallow rules, making it compliant with industry best practices.

🔍 Detection Indicators

The primary User-Agent string for teezirbot is Mozilla/5.0 (compatible; teezirbot/2.0; +https://teezir.com/bot). It also includes a Via header that reveals the Teezir server origin. Behavioral fingerprints include a consistent request interval, sequential URL scanning patterns, and the absence of referrer headers from external domains. The bot does not download large files or execute JavaScript beyond basic page rendering.

📊 Data Usage

Data collected by teezirbot is used exclusively for Teezir’s SEO audit and competitive analysis services. This includes page titles, meta descriptions, internal and external link counts, page load times, and HTTP status codes. The information is aggregated into client reports that help website owners identify broken links, duplicate content, and optimization opportunities. No personally identifiable information (PII) is intentionally harvested, and all data is stored subject to Teezir’s privacy policy.

⚙️ Rate Limiting Policy

Rate limiting for teezirbot is recommended because, while it respects Crawl-Delay, aggressive configuration (e.g., setting delay to 1 second or less) can still strain low-resource servers. A threshold-based block at 20 requests per minute per IP is prudent to preserve server health, with an allowance of up to 200 requests per hour for deeper crawls, ensuring the bot can complete its audit without overwhelming the target.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.