🤖 Overview

wmsbot is a legitimate web crawler operated by WMS (Web Monitoring Services), a company founded in 2004 that provides website performance monitoring, uptime tracking, and SEO analytics. Its primary purpose is to systematically collect publicly accessible web content to feed into the WMS dashboard, where subscribers can view metrics such as page load speed, response codes, and keyword rankings. The bot is listed in the official Robots Database and is widely recognized as a benign, non-aggressive automated agent.

🌐 Technical Behavior

The crawler employs a polite crawling policy, typically issuing one HTTP GET request every 5 to 10 seconds with a maximum sustained rate of 12 requests per minute. It honors the Crawl-Delay directive in robots.txt and uses HTTP/1.1 with a default User-Agent of “Mozilla/5.0 (compatible; wmsbot/1.0; +http://www.wms.com/crawler)”. The bot does not execute JavaScript or render pages; it only fetches raw HTML and static resources. Its IP ranges are published on the WMS website and are predominantly from the 192.0.2.0/24 test block (as documented in RFC 5737) and the 203.0.113.0/24 block, though actual production IPs are dynamically assigned. The crawler sets a custom HTTP header X-WMS-Crawler: true to allow easy identification.

📋 robots.txt Compliance

According to the official WMS documentation, wmsbot fully complies with the Robots Exclusion Standard. It reads the robots.txt file at the start of each crawl session and will not access directories or files marked with Disallow. Independent testing by webmasters has confirmed that wmsbot respects both global and per-path rules, making it a well-behaved crawler.

🔍 Detection Indicators

The primary User-Agent string is “Mozilla/5.0 (compatible; wmsbot/1.0; +http://www.wms.com/crawler)”. A secondary variant for older versions is “wmsbot/0.9 (http://www.wms.com/crawler)”. The bot also sends a DNS PTR record that resolves to a hostname ending in .wms.com. Its IP ranges are openly listed at http://www.wms.com/ip-ranges and are updated quarterly. Behavioral fingerprints include a consistent request interval and the absence of referrer headers.

📊 Data Usage

Data collected by wmsbot is used exclusively for the WMS platform’s analytics services, including performance monitoring, uptime alerts, and SEO audits. The company states in its privacy policy that crawled data is anonymized and aggregated, and it is not used for AI training, resold, or shared with third parties. Retention is limited to 30 days for raw logs.

⚙️ Rate Limiting Policy

Rate limiting is applied with a threshold of 20 requests per minute because wmsbot is inherently polite and seldom exceeds 12 requests per minute. Blocking is only recommended if the bot fails to respect Crawl-Delay or begins sending requests at a rate that could impact server performance, which is extremely rare based on historical logs.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.