🤖 Overview

x22Mozilla is a web crawler operated by X22 GmbH, a German company specializing in search engine optimization and web data extraction services, as documented on their official website x22.de. The bot is designed to systematically index web content for use in SEO analytics tools, backlink monitoring, and competitive intelligence platforms offered by X22.

🌐 Technical Behavior

x22Mozilla emulates a real browser by appending “Mozilla/5.0” to its User-Agent string, mimicking Chrome or Firefox to bypass basic bot detection. Crawl patterns follow a depth‑first strategy, visiting linked pages at intervals of 2‑5 seconds, with bursts of up to 50 requests per minute on high‑priority sites. IP addresses originate from a pool of residential proxies and datacenter IPs primarily in Germany and the Netherlands, with ranges such as 185.49.84.0/22 and 2a01:4f8:c0c:3c2e::/64 reported in public log analyses. The bot uses HTTP/1.1 with a keep‑alive connection and sends a Referer header set to the previous page URL. It requests both HTML pages and resource files (.css, .js) to evaluate page load performance.

📋 robots.txt Compliance

Based on X22’s published documentation at x22.de/robots.txt and verified via independent webmaster forums, x22Mozilla fully honors Disallow directives and respects Crawl‑Delay instructions. The bot reads robots.txt at the start of each crawl session and caches it for 24 hours. No confirmed cases of non‑compliance have been reported in official security advisories.

🔍 Detection Indicators

The primary User‑Agent string is “Mozilla/5.0 (compatible; x22Mozilla/1.0; +https://x22.de/bot)”, though variations like “x22Mozilla/2.0” are also observed. Behavioural fingerprints include a fixed request interval of 2 seconds between pages and a distinctive X‑X22‑Crawl‑ID header containing a UUID. The bot does not accept cookies and always sends an empty Accept‑Encoding header, unlike typical browsers.

📊 Data Usage

Collected data—including page titles, meta descriptions, HTTP status codes, and link structures—is fed into X22’s SEO Suite for competitor analysis, rank tracking, and link building recommendations. The company claims no data is used for AI model training, per their privacy policy at x22.de/privacy. Aggregated metrics are sold as subscription‑based reports.

⚙️ Rate Limiting Policy

This bot is rate‑limited because its burst behaviour can overload shared hosting environments during peak scraping hours; a threshold‑based block after 200 requests per minute is recommended to preserve server resources without outright denial of service. Administrators should configure throttling at the reverse‑proxy or WAF level if crawl volume exceeds configured limits.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.