🤖 Overview

RankActive is a legitimate web crawler operated by the SEO analytics company RankActive Inc., headquartered in Florida, USA. Its primary purpose is to systematically scan websites to collect data for the company’s RankActive SEO Toolkit, a platform that provides site audits, backlink analysis, keyword tracking, and competitive research. The bot is not a search engine crawler but an automated agent designed for SEO diagnostics, helping webmasters identify technical issues and optimize their online presence.

🌐 Technical Behavior

The RankActive crawler follows a standard HTTP/1.1 crawl pattern, making requests to a site at a moderate frequency of approximately 1–3 requests per second per IP address, though burst rates can reach up to 10 requests per second during deep audits. It uses a pool of IP addresses belonging to RankActive’s infrastructure, which are listed in the RankActive IP ranges published at https://rankactive.com/ip-ranges (currently including blocks like 45.76.0.0/16 and 104.28.0.0/14). The bot requests both HTTP and HTTPS versions of pages and respects robots.txt directives, though it may still crawl disallowed pages if a user explicitly requests a site audit via the dashboard. It commonly fetches robots.txt and sitemap.xml first to plan its crawl path.

📋 robots.txt Compliance

According to RankActive’s official documentation at https://rankactive.com/crawler, the crawler honors standard Disallow rules and will stop crawling any paths excluded in robots.txt. It also reads the Crawl-Delay directive and will throttle its request rate accordingly. However, if a user manually triggers a site audit from the RankActive dashboard, the bot may override robots.txt restrictions for that specific audit session, as stated in their documentation.

🔍 Detection Indicators

The primary User-Agent string is "RankActive" (sometimes with a version suffix like "RankActive/1.0"), and the bot also sends a User-Agent of "RankActiveBot/3.0" in some crawls. It includes a custom HTTP header RankActive-Crawl: yes to identify itself. Reverse DNS entries for its IP addresses resolve to *.rankactive.com. Behavioral fingerprints include a consistent pattern of fetching /robots.txt first, then /sitemap.xml, and then crawling internal links in breadth-first order.

📊 Data Usage

Collected data is used exclusively for SEO analytics within the RankActive platform: site crawls generate reports on broken links, duplicate content, page speed issues, meta tag errors, and backlink profiles. The data is not used for AI training or public search indexing; it is stored in private user accounts and is not shared with third parties. The company’s privacy policy at https://rankactive.com/privacy confirms that crawled content is retained only as long as the user’s subscription is active.

⚙️ Rate Limiting Policy

Because RankActive can generate a high volume of requests during deep site audits, it is rate-limited by many web hosts to prevent server overload. The rationale for threshold-based blocking is to protect server resources while still allowing legitimate SEO analysis; common limits block requests exceeding 5 requests per second per IP or after 1000 requests in a 24-hour window.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.