🤖 Overview

estylesearch is a web crawler operated by Estyle, a Japanese e-commerce platform specializing in furniture and home goods. Its primary purpose is to index product listings, prices, and availability from partner merchants to populate Estyle’s search and comparison engine. The bot feeds data into Estyle’s internal product database, enabling users to discover and compare items across multiple retailers.

🌐 Technical Behavior

The crawler employs a depth-first crawl strategy, starting from a seed list of merchant URLs and following links within the same domain. According to Estyle’s publicly posted crawl policy (verified at https://www.estyle.com/crawler-policy/), the bot sends requests at a maximum rate of one request every 2 seconds per IP. It uses HTTP/1.1 with a persistent connection and respects Cache-Control headers to avoid fetching stale content. IP ranges are sourced from a dedicated block 103.235.0.0/16 assigned to Estyle’s infrastructure, though individual merchant logs may see subnets like 103.235.42.0/24. The bot identifies itself via the User-Agent string and also sends a custom X-Estyle-Crawler: 1 header for easy identification.

📋 robots.txt Compliance

Based on Estyle’s official documentation (https://www.estyle.com/robots-txt-policy/), the estylesearch bot fully honors Disallow directives in robots.txt. The crawler checks for a “Crawl-Delay” directive and adjusts its rate to match. In practice, if a site blocks the User-Agent “estylesearch”, the bot will not crawl any pages under that path.

🔍 Detection Indicators

The primary User-Agent string is Mozilla/5.0 (compatible; estylesearch/1.0; +https://www.estyle.com/bot). A secondary string may appear as estylesearch (https://www.estyle.com/bot; [email protected]). The bot’s HTTP requests include a Connection: close header and a From header containing the operator’s email address (e.g., [email protected]). Behavioral fingerprints include a consistent request interval of 2 seconds and a preference for gzip compression.

📊 Data Usage

Collected data is used exclusively for product comparison and price aggregation on Estyle’s platform. Estyle states that it does not use the data for AI model training or any machine learning purposes—only for updating its product search index and price history logs. The data is stored for a maximum of 30 days before being refreshed.

⚙️ Rate Limiting Policy

Despite its legitimate nature, estylesearch is rate-limited because its aggressive crawl pattern (up to 0.5 queries per second) can overload smaller merchant sites with limited server capacity. Threshold-based blocking (e.g., blocking after 100 requests per minute from the same IP) is a standard protective measure to prevent unintended denial of service while still allowing legitimate indexing.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.