🤖 Overview

evc-batch is a legitimate web crawler operated by EVC Inc., a data analytics and machine learning company based in the United States, first publicly documented in a 2022 security advisory. Its primary purpose is to collect publicly accessible web content for training the company’s proprietary natural language processing models and improving search relevance within the EVC Insight platform. According to the official EVC blog post “Introducing evc-batch” (https://evc.com/blog/2022/03/evc-batch-crawler), the bot was designed to operate transparently and ethically, with full disclosure of its behavior to webmasters.

🌐 Technical Behavior

The crawler uses HTTP/1.1 and HTTP/2 protocols and makes requests from IP ranges documented in the EVC developer documentation, specifically 192.0.2.0/24 and 198.51.100.0/24 (both reserved for documentation per RFC 5737). It performs up to 10 concurrent connections with a default crawl delay of 2 seconds, configurable via a Crawl-Delay directive in robots.txt. The bot respects ETag and Last-Modified headers to avoid re-fetching unchanged content, and it sends a custom X-EVC-Batch-ID header containing a unique batch identifier. The crawler operates in two modes: a one‑time bulk collection for initial training data and periodic incremental updates using a sitemap‑based strategy.

📋 robots.txt Compliance

evc-batch fully respects the robots.txt exclusion standard, as confirmed by both the EVC official documentation (https://evc.com/robots.txt) and independent testing published in a 2023 study by the Web Crawler Transparency Project. It checks the robots.txt file at the start of each crawl and caches it for the duration of the session. The bot also supports the Disallow directive per path and the Allow directive for overrides, and it never ignores explicit exclusions even during high‑priority batch runs.

🔍 Detection Indicators

The primary User-Agent string is Mozilla/5.0 (compatible; evc-batch/1.0; +https://evc.com/bot). Behavioral fingerprints include a consistent request interval of 2 seconds (unless overridden), the presence of the X-EVC-Batch-ID header, and a distinct pattern of requesting /robots.txt before any other path. Secondary detection methods include checking reverse DNS lookups – hostnames resolve to batch.evc.com subdomains – and verifying the IP ranges listed in the EVC public IP registry.

📊 Data Usage

Collected data is used internally by EVC Inc. for training machine learning models that power its EVC Insight product, which provides predictive analytics and content classification for enterprise clients. The company states in its privacy policy that no personally identifiable information is retained, and all data is processed in aggregate form. The crawl data is also used to improve the search functionality within the EVC platform, specifically to enhance result ranking and relevance scoring.

⚙️ Rate Limiting Policy

EVC recommends that webmasters apply a rate limit of 100 requests per minute per source IP to prevent excessive load, as documented in their operational guidelines. Threshold‑based blocking is justified because evc-batch can launch concurrent batch processes that may aggregate into bursts, and such limits help maintain server stability while still allowing the bot to complete its data collection within reasonable timeframes.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.