🤖 Overview

Stripper is a legitimate web crawler operated by Stripper Inc., a data extraction service founded in 2019, designed to collect publicly available web content for use in analytics, price monitoring, and feed aggregation. The bot is documented at stripper.io/bot and is intended for automated content retrieval to support market research and competitive intelligence.

🌐 Technical Behavior

Stripper crawls using HTTP/1.1 and HTTP/2 protocols, sending requests at an average rate of 10 requests per second per source IP, with bursts up to 50 requests per second. It rotates through IP ranges allocated from AS16509 (Amazon) and AS14618 (Amazon), specifically 52.0.0.0/8 and 35.0.0.0/8, and also uses residential proxy networks. The bot respects Cache-Control headers and retrieves both HTML and linked resources such as CSS and JavaScript to parse dynamic content. It identifies itself via User-Agent strings like Stripper/2.0 (compatible; +https://stripper.io/bot) and includes a Stripper-Client header with a machine-readable customer token. Crawl depth is limited to 10 levels by default, and it does not follow redirects beyond three hops.

📋 robots.txt Compliance

According to the official documentation at stripper.io/robots, Stripper fully obeys Disallow rules in robots.txt files and also honors Crawl-Delay directives. The bot checks robots.txt on every domain before each crawl session and caches the file for up to one hour. There is no evidence of deliberate robots.txt violations in public security advisories; however, due to misconfigurations, some sites have reported unintended crawling of restricted paths, which Stripper Inc. resolves upon email notification.

🔍 Detection Indicators

Detection of Stripper is accomplished via its User-Agent string: Mozilla/5.0 (compatible; Stripper/2.0; +https://stripper.io/bot) and the custom HTTP header Stripper-Client: [customer-id]. Behavioral fingerprints include a high frequency of requests from the same subnet, and a pattern of requesting robots.txt first, followed by pages in depth-first order. The bot also sends a Referer header set to the root of the crawled domain.

📊 Data Usage

Collected data is used exclusively by Stripper Inc.'s paying customers for market analysis, price optimization, and content aggregation. The service does not train any large language models or sell raw data to third parties. According to their privacy policy (stripper.io/privacy), all data is anonymized and stored encrypted for a maximum of 90 days.

⚙️ Rate Limiting Policy

Stripper is rate-limited because its automated high-frequency requests can degrade server performance for other users; a threshold-based block is recommended at 100 requests per minute per IP to maintain service stability without blocking legitimate access.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.