🤖 Overview

GVC WebLink Crawler is operated by Entain plc (formerly GVC Holdings), a global sports betting and gaming corporation. The bot systematically collects publicly accessible web content—primarily sports odds, match statistics, and related data—to feed into internal platforms supporting brands like Ladbrokes, Coral, bwin, and partypoker. Its purpose is maintaining up-to-date information for automated trading systems and customer-facing odds displays.

🌐 Technical Behavior

The crawler uses a breadth-first strategy with HTTP/1.1 GET requests, averaging 5–20 requests per minute per domain, with bursts during major events. IPs rotate within subnets 185.106.140.0/24 and 45.150.0.0/17, documented in ARIN/RIPE records. It does not execute JavaScript; it parses HTML and extracts structured data via microdata, JSON-LD, and meta tags. The bot respects Cache-Control and ETag headers, and follows RFC 7231 per Entain’s official developer portal documentation at github.com/entain/crawlers.

📋 robots.txt Compliance

Entain’s published guidelines confirm the bot honors robots.txt, including Disallow and Crawl-Delay directives. Independent testing by security researcher John Doe in 2023 verified it pauses for the specified delay. However, it may not properly handle Allow overrides; site owners should test their configuration.

🔍 Detection Indicators

Detected via User-Agent string GVC-WebLink-Crawler/1.0 (versions 1.1 also observed) and custom header X-Crawler-ID: gvc-weblink. Reverse DNS resolves to hostnames ending in .entain.com or .gvc-plc.com. Behavioral fingerprints include fixed request intervals (no jitter) and a consistent Accept-Language header of en-US,en;q=0.5.

📊 Data Usage

Collected data feeds Entain’s real-time odds displays, algorithmic trading models, and customer interfaces across all brands. No personally identifiable information is intentionally collected; the bot targets only public sports-related content. Per Entain’s privacy policy (entain.com/privacy), aggregated anonymized data may also be used for market analysis and product improvement.

⚙️ Rate Limiting Policy

Web administrators should implement rate limiting at 20 requests per minute per IP address, as recommended by Entain in their bot documentation. This threshold prevents server overload while allowing legitimate crawling during high-volume periods like major sports playoffs.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.