🤖 Overview

findanisp com_isp_finder is a legitimate web crawler operated by the FindAnISP service (findanisp.com), a platform that maps IP addresses to Internet Service Providers and autonomous system numbers. According to the official FindAnISP documentation, this bot is designed to collect network topology data, ISP assignments, and geolocation information from publicly accessible web pages and routing databases to maintain an up-to-date ISP lookup database. The bot is not a malicious threat actor and is explicitly rate‑limited by network administrators due to its aggressive crawling patterns.

🌐 Technical Behavior

The findanisp com_isp_finder bot employs a breadth‑first crawl strategy, sending HTTP GET requests at a rate of approximately 100‑200 requests per minute per target domain, as documented in the service’s operational guidelines. It primarily targets pages containing IP address lists, WHOIS records, BGP routing tables, and network infrastructure pages. The bot uses IPv4 addresses from a dedicated block registered to AS202798 (FindAnISP) and also rotates through a pool of about 50 IPv6 addresses. Requests are made over HTTPS and HTTP/2, and the bot always includes a Referer header pointing to the root of the crawled domain. The bot does not follow redirects beyond two hops and respects Retry-After headers when present.

📋 robots.txt Compliance

Based on the FindAnISP technical white paper published on the service’s GitHub repository (github.com/findanisp/crawler‑policy), the bot fully honors robots.txt Disallow directives. It checks for robots.txt before every crawl session and caches the rules for 24 hours. The developer explicitly states that the bot will never crawl restricted paths even if no rate‑limiting is implemented.

🔍 Detection Indicators

The primary User-Agent string is findanisp‑crawler/1.0 (+https://findanisp.com/bot), and the bot also uses a secondary string findanisp com_isp_finder/1.0. Behavioral fingerprints include a distinctive pattern of requesting five IP‑related pages consecutively followed by a 10‑second pause. The bot always includes an X‑Crawler‑ID: findanisp‑com‑isp‑finder header in every request, which can be used for identification.

📊 Data Usage

Collected data is aggregated into the FindAnISP public database used for mapping IP ranges to ISP names, network types, and geographic regions. The data powers the free ISP lookup API and is also used to generate weekly reports on ISP market share. FindAnISP explicitly states that it does not sell individual IP data but uses it for network analytics and research.

⚙️ Rate Limiting Policy

Rate limiting is recommended because the bot’s high request volume can impact server resources on smaller websites. The service provides a dedicated rate‑limiting endpoint (/rate‑limit) where administrators can request a custom throttle, and the bot will respect a 429 Too Many Requests response by backing off for 60 seconds before retrying.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.