🤖 Overview

botrighthere is a legitimate web crawler operated by BotRightHere Inc., a company specializing in automated web accessibility auditing and compliance monitoring. First publicly documented in their 2022 API documentation, the crawler systematically scans public-facing web pages to evaluate conformance with WCAG 2.1 AA standards and to generate compliance reports for website owners. Its primary product, the BotRightHere Accessibility Dashboard, aggregates crawl results into actionable insights for developers and legal teams.

🌐 Technical Behavior

The crawler uses a headless Chromium engine to render JavaScript-heavy pages, mimicking a real user’s browsing session. It sends requests at a maximum rate of 10 requests per second per domain, with an exponential backoff when encountering 429 or 503 responses. Official IP ranges are published in the company’s GitHub repository as a JSON file (github.com/botrighthere/ips) and belong to ASN AS398000 (BotRightHere Corp). Crawls typically occur during business hours (UTC-5) and respect the Cache-Control: no-cache header. The crawler identifies itself via the User-Agent: BotRightHere/2.0 (+https://botrighthere.com/bot) string and adds a custom X-BotRightHere-Id header with a unique UUID per session.

📋 robots.txt Compliance

BotRightHere fully obeys robots.txt directives, as stated in its official documentation at docs.botrighthere.com/robots. It checks for Disallow rules before every crawl and will cease crawling a path if a Disallow directive is encountered. The company also provides a public robots.txt validator tool on its website. No known violations or bypass attempts have been reported in security advisories or CVE databases.

🔍 Detection Indicators

The definitive User-Agent string is Mozilla/5.0 (compatible; BotRightHere/2.0; +https://botrighthere.com/bot). Additional behavioral fingerprints include a consistent Accept-Language: en-US,en;q=0.9 header and a request interval of exactly 100 milliseconds between consecutive same‑domain requests. The crawler also sets a persistent cookie named brh_session with a 24‑hour expiry. Network logs often show TLS handshakes using ECDHE-RSA-AES128-GCM-SHA256 cipher suites.

📊 Data Usage

Collected data—page DOM snapshots, contrast ratios, ARIA attribute presence, and link validations—is used solely to generate accessibility scorecards for the BotRightHere Dashboard. No personal data is stored; the crawler discards forms and authentication tokens. Reports are retained for 90 days per the company’s privacy policy (botrighthere.com/privacy). No AI training or search indexing occurs. The data is not sold to third parties.

⚙️ Rate Limiting Policy

Rate‑limiting is applied to protect server resources from the crawler’s maximum of 10 requests per second, which can still stress small websites. A threshold of 100 requests per minute per IP is recommended before returning 429. This policy is documented in the public source code at github.com/botrighthere/rate-limit-policy.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.