🤖 Overview

Tecomi Bot is a legitimate web crawler operated by Tecomi Co., Ltd., a Japanese technology company that maintains the Tecomi search engine. First documented in 2019, this bot systematically collects publicly accessible web pages to build and update the Tecomi search index, which is used to provide search results for users primarily in Japan and East Asia. Tecomi explicitly states on its official website (tecomi.com/bot) that the crawler is designed solely for indexing and does not collect personal or copyrighted content without permission.

🌐 Technical Behavior

Tecomi Bot employs a crawl policy that respects Crawl-delay directives and typically requests pages at a rate of 10–20 requests per second, though this can spike during initial crawls of new domains. The bot uses HTTP/1.1 and HTTP/2 protocols and identifies itself via the User-Agent string TecomiBot/2.0. Its source IP ranges are allocated from ASN 59253 (Tecomi Networks) and include prefixes such as 103.235.0.0/16 and 203.104.0.0/16, all geolocated in Japan. According to official documentation, the crawler also supports If-Modified-Since headers to reduce unnecessary bandwidth consumption and respects noindex meta tags in page HTML.

📋 robots.txt Compliance

Tecomi Bot fully honors robots.txt Disallow directives as confirmed in the company’s public crawler policy (tecomi.com/robots-policy). The documentation explicitly states that any path disallowed in robots.txt will not be fetched, and the bot also respects Crawl-delay values. Independent tests by webmasters indicate that Tecomi Bot does not attempt to access blocked resources even when encountering 403 or 401 responses.

🔍 Detection Indicators

The primary detection fingerprint is the User-Agent Mozilla/5.0 (compatible; TecomiBot/2.0; +https://tecomi.com/bot). The bot also sends a custom HTTP header X-Robot-Identity: TecomiBot/2.0 and a From header bearing the email address [email protected]. Logs often show a consistent pattern of sequential IPs from the allocated ranges and a request frequency that matches the declared crawl delay.

📊 Data Usage

Collected data is used exclusively to populate the Tecomi search index, which ranks pages based on relevance and freshness. According to Tecomi’s privacy policy (tecomi.com/privacy), page content is stored temporarily for indexing and does not feed into any AI training models or third-party analytics. The company also provides a removal tool for site owners who wish to exclude their content from search results entirely.

⚙️ Rate Limiting Policy

Although Tecomi Bot is legitimate and responsive to robots.txt, it is rate-limited because its default crawl speed can still cause load on smaller servers. The policy rationale for threshold-based blocking is to ensure that the bot does not degrade web application performance while still allowing normal indexing activities. Typical rate limits are set at 50 requests per minute per IP, with automatic throttling if the server responds with 429 or 503 status codes.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.