ezooms

Bot User-Agent: ezooms

🤖 Overview

Ezooms is a web crawler originally operated by ezooms Inc., which was acquired by and now serves as the legacy crawler for SEMrush, a leading SEO and digital marketing analytics platform. Its primary purpose is to systematically collect publicly accessible web content for SEMrush’s suite of tools, including backlink analysis, site audits, keyword research, and competitor intelligence. The bot feeds data into SEMrush’s proprietary database used by millions of marketers worldwide.

🌐 Technical Behavior

Ezooms performs HTTP GET requests using standard HTTP/1.1 with a configurable crawl delay typically set to 2–10 seconds per page, as recommended in SEMrush’s official documentation. It employs a distributed crawling architecture, often originating from IP ranges assigned to Amazon Web Services (AWS), with specific subnets documented on SEMrush’s support page. The crawler respects the Crawl-Delay directive in robots.txt and can be throttled via the crawl-delay meta tag, although its default aggregation logic may issue bursts of requests for multiple URLs simultaneously. SEMrush publishes a list of IP addresses and CIDR blocks (e.g., 54.236.0.0/18) used by Ezooms, which change periodically. It does not use JavaScript rendering but parses static HTML and links.

📋 robots.txt Compliance

According to SEMrush’s official documentation and user-agent pages, Ezooms fully honors Disallow directives in robots.txt. The bot checks the file before each crawl session and will not access paths explicitly forbidden. SEMrush advises site owners to use standard robots.txt rules to block sections like /admin or /private; noncompliance can be reported via their support channels.

🔍 Detection Indicators

The primary User-Agent string is "Mozilla/5.0 (compatible; Ezooms/1.0; +http://www.ezooms.com)" for legacy crawls, while newer deployments use "Mozilla/5.0 (compatible; SEMrushBot/1.2; +http://www.semrush.com/bot.html)". Behavioral fingerprints include a request interval of 2–5 seconds by default, a lack of Accept-Language headers, and reverse DNS entries resolving to *.ezooms.com or *.semrush.com. Server logs often show the bot’s user agent and a consistent Via header from SEMrush’s proxy network.

📊 Data Usage

Collected data is used exclusively for SEMrush’s SaaS products: Site Audit (crawling site structure and identifying technical SEO issues), Backlink Analytics (discovering inbound links), Position Tracking (rankings), and Competitor Research. The content is indexed into SEMrush’s own database and not used for large language model training. SEMrush does not sell raw crawled data to third parties; it remains within their analytics ecosystem.

⚙️ Rate Limiting Policy

Webmasters rate-limit Ezooms because its default crawl pattern can be aggressive on high-traffic sites, especially when crawling thousands of pages in a short time. Threshold-based blocking at, for example, 20 requests per minute ensures the bot does not degrade server performance while still allowing legitimate SEO data collection as defined by SEMrush’s published rate limits.

Free Bot Analysis

Is Your Site Under Bot Attack Right Now?

Find out exactly how much of your traffic is automated — and which bots are draining your bandwidth and skewing your analytics.

Run Free Bot Scan →

No credit card required  ·  Results in minutes

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.