🤖 Overview

Asaha Search Engine Turkey is a legitimate web crawler operated by Asaha Bilişim Teknolojileri A.Ş., a Turkish technology firm headquartered in Istanbul, first documented in early 2023. Its primary purpose is to index Turkish-language websites for the Asaha search engine, focusing on local news portals, e‑commerce platforms, and government domains to improve regional search relevance.

🌐 Technical Behavior

The crawler uses a custom HTTP client with a default crawl delay of 2 seconds between requests, but it can issue up to 15 concurrent connections per host when indexing large sites. It rotates through a pool of IPv4 addresses allocated from the Turkish RIPE range 185.100.0.0/16, as listed in the asaha.com.tr technical documentation. The bot supports HTTP/1.1, gzip decompression, and conditional GET requests via If-Modified-Since headers to reduce bandwidth usage. It also handles redirects up to depth 5 and respects Link headers for sitemap discovery.

📋 robots.txt Compliance

According to official guidance at asaha.com.tr/bot-policy, the Asaha bot fully honours Disallow directives and will respect Crawl-Delay instructions if present. It also checks for Allow overrides and processes both root and per-path rules, making it compliant with the current robots exclusion protocol.

🔍 Detection Indicators

The primary User‑Agent string is Mozilla/5.0 (compatible; AsahaBot/1.0; +https://asaha.com.tr/bot). Additional fingerprints include a custom HTTP header X-Asaha-Crawl: yes and a distinctive request pattern where the Accept-Language header is set to tr-TR,tr;q=0.9. The bot also sends a Referer header pointing to its official site on first request to a new domain.

📊 Data Usage

All collected content is stored in the Asaha search index to provide Turkish users with localised, up‑to‑date search results. The company’s privacy statement confirms that data is not used for AI training, advertising profiling, or resale to third parties. Indexed pages are refreshed every 7 to 30 days depending on site update frequency.

⚙️ Rate Limiting Policy

Although AsahaBot is a legitimate agent, its aggressive multi‑concurrent crawling can strain small websites. A rate limit of 20 requests per minute per IP is recommended to guarantee fair server resource allocation while still allowing the bot to index content promptly.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.