🤖 Overview

Inelabot is a web crawler operated by Inela, a Spanish technology company specializing in AI-driven data extraction and content analysis. Launched in 2020, its primary purpose is to collect publicly accessible web content for training Inela’s proprietary natural language processing (NLP) models and improving their search and summarization products. The bot is documented in Inela’s official developer portal under the “Crawlers” section.

🌐 Technical Behavior

Inelabot follows a depth-first crawl strategy with a configurable crawl delay, typically set to 5 seconds between requests to the same host. It sends requests over both HTTP/1.1 and HTTP/2, and uses the Accept-Encoding: gzip, deflate header to reduce bandwidth. The bot resolves IPv4 and IPv6 addresses from the ASN AS198610 (Inela’s own subnet), with IP ranges publicly listed in its robots.txt host directive. Crawl depth is limited to 10 levels by default, and it avoids binary files (e.g., .exe, .zip) unless explicitly allowed in a site’s robots.txt. Inelabot does not parse JavaScript-rendered content unless the site provides a static snapshot.

📋 robots.txt Compliance

According to Inela’s official documentation (https://inela.com/crawler/robots), Inelabot fully respects robots.txt directives, including Disallow, Allow, Crawl-Delay, and the non-standard Request-Rate extension. Compliance is enforced at the request level using a local cache that revalidates the file every 60 minutes. Several website operators have confirmed that Inelabot stops crawling paths immediately after a Disallow is published.

🔍 Detection Indicators

The primary User-Agent string is Inelabot/1.0 (+https://inela.com/crawler), though some variations include version numbers (e.g., Inelabot/2.1). Additional identifying headers are X-Inela-Crawler: 1 and From: [email protected]. The bot’s requests always include a Via header indicating the proxy gateway used. IP addresses are listed in the official IP range feed at https://inela.com/crawler/ips.txt.

📊 Data Usage

Collected data is used exclusively for training AI models that power Inela’s text analytics platform, including sentiment analysis, entity recognition, and document summarization. Inela’s privacy policy states that no personally identifiable information (PII) is intentionally harvested, and any accidentally collected PII is anonymized within 72 hours. The data is not shared with third parties and is stored on servers located in Spain under GDPR compliance.

⚙️ Rate Limiting Policy

Inelabot is rate-limited because its crawl speed can scale up to 100 requests per second when not throttled by a site’s Crawl-Delay, potentially overwhelming small web servers. Rate-limiting via threshold-based blocking ensures site performance is not degraded while still allowing the bot to collect data for AI training purposes.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.