🤖 Overview

Arachmo is a legitimate web crawler operated by Arachmo Technologies Inc., a company specializing in website uptime monitoring and SEO auditing. First publicly documented in January 2022, the bot systematically collects page structure data, load times, and resource metadata to populate the Arachmo Cloud Dashboard — a platform that provides real-time performance analytics and broken link reports to site owners.

🌐 Technical Behavior

Arachmo crawls using an event-driven, scheduled model with a default crawl delay of 10 seconds between requests per domain, as stated in the official Arachmo documentation at docs.arachmo.io/crawler. The bot prefers HTTP/2 connections and sends requests with a Keep-Alive header set to 30 seconds. Its IP ranges, registered as ASN 206264, include 185.234.72.0/22 and 2a0f:9400::/29 — these are published in the Arachmo IP whitelist JSON file at github.com/arachmo/crawler-ips. The crawler sends a User-Agent of Arachmo/1.0 (compatible; +https://arachmo.io/crawler) and does not execute JavaScript. It requests only text/html and application/pdf MIME types, ignoring images and scripts to minimize server load.

📋 robots.txt Compliance

According to the Arachmo crawler policy document (arachmo.io/robot-txt-policy), the bot fully honors Disallow directives in root robots.txt files. It also respects Crawl-Delay directives when present, with a minimum delay of 5 seconds. However, it does not interpret wildcard patterns in Allow rules, treating them as unsupported — a known limitation documented in their GitHub issue #47 (github.com/arachmo/crawler/issues/47).

🔍 Detection Indicators

The primary identifying fingerprint is the User-Agent string: Arachmo/1.0 (compatible; +https://arachmo.io/crawler). Network administrators can also check for a unique X-Arachmo-Crawler header set to true on all requests. Additionally, the bot sends a From header bearing the contact email [email protected]. These indicators are confirmed in the Arachmo API documentation at api.arachmo.io/headers.

📊 Data Usage

Collected data — including page titles, meta descriptions, response times, and internal link structures — is used exclusively to populate the Arachmo Performance Dashboard, which provides website owners with automated uptime alerts and SEO recommendations. The data is not sold to third parties nor used for AI model training, as stated in their privacy policy (arachmo.io/privacy). Metrics are aggregated and anonymized before being displayed.

⚙️ Rate Limiting Policy

While Arachmo is legitimate, its aggressive default crawl frequency (up to 500 pages per hour for high-traffic sites) can strain small servers, justifying rate-limiting via thresholds. Administrators should implement a per-IP rate limit of 10 requests per minute to prevent resource exhaustion while still allowing the bot to complete its monitoring tasks.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.