🤖 Overview

Axonize-bot is a legitimate web crawler operated by Axonize Inc., an American IoT and machine learning analytics company headquartered in San Jose, California. First observed in 2019 and documented on Axonize's official developer portal at https://developers.axonize.com/bots, its primary purpose is to collect publicly accessible web content—such as technical articles, product documentation, and IoT sensor data feeds—to train and improve Axonize’s Insight Engine predictive analytics platform.

🌐 Technical Behavior

The crawler sends requests at a moderate rate of one request every 15 to 20 seconds by default, using both HTTP/1.1 and HTTP/2 protocols. Its IP ranges are allocated from Axonize’s own autonomous system AS200601, with a block of addresses in the 185.123.0.0/16 subnet, typically seen as 185.123.12.0/24. It performs conditional requests using If-Modified-Since and If-None-Match headers to minimise bandwidth usage, and only crawls text-based content (HTML, JSON, XML), ignoring binaries and images unless explicitly allowed via Allow directives.

📋 robots.txt Compliance

Based on Axonize’s published guidelines at https://axonize.com/robotstxt, Axonize-bot fully honours all Disallow directives and respects Crawl-Delay instructions. It has been independently verified by webmasters to obey robots.txt without exception; the bot does not attempt to bypass restrictions or access blocked paths.

🔍 Detection Indicators

The primary User-Agent string is Mozilla/5.0 (compatible; Axonize-bot/1.0; +https://axonize.com/bot). Additional fingerprints include the HTTP header X-Axonize-Bot: true and a reverse DNS record matching *.crawler.axonize.com. Behavioral indicators include a consistent crawl interval, exclusive use of GET requests, and a default Accept header of text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8.

📊 Data Usage

Collected data is used solely for internal model training within Axonize’s Insight Engine, which powers IoT anomaly detection, predictive maintenance, and real-time analytics for enterprise customers. According to their privacy policy (https://axonize.com/privacy), all data is anonymized and aggregated before ingestion, and it is never resold or shared with third parties.

⚙️ Rate Limiting Policy

While Axonize-bot is a legitimate, well-behaved agent, its cumulative requests from multiple concurrent crawls can still impose load on smaller servers. A standard rate limit of 5 requests per second per IP, with a burst allowance of 20 requests, is recommended to ensure resource availability for other visitors while allowing the bot to complete its indexing tasks without disruption.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.