🤖 Overview

daumoa is a web crawler operated by Kakao Corp, the parent company of Daum Communications, a major South Korean internet portal. Its primary purpose is to index publicly accessible web content for the Daum Search engine (search.daum.net), which provides search results for Korean-language and global websites. Daumoa has been active since at least 2009 and is considered a legitimate, rate-limited crawler that follows standard web crawling protocols.

🌐 Technical Behavior

Daumoa performs standard HTTP GET requests to retrieve web pages, often using a request frequency that can range from a few requests per minute to higher bursts depending on the site's response. The crawler operates from IP addresses within Kakao's ASN AS9318 (Kakao Corp), with ranges including 110.45.x.x, 121.78.x.x, and 211.234.x.x, as confirmed by reverse DNS lookups (e.g., daumoa.crawl.kakao.com). It supports HTTP/1.1 and HTTPS, and respects standard crawl delays defined in robots.txt. The crawler typically visits pages in a breadth-first manner, prioritizing fresh content and links from known high-authority domains. Daumoa may also request gzip compressed content and follows redirects (301, 302). It does not appear to crawl JavaScript-rendered content aggressively, focusing on static HTML.

📋 robots.txt Compliance

According to official Daum documentation (available at https://searchadvisor.daum.net/robots), daumoa respects the Disallow directives in robots.txt and will not crawl paths explicitly blocked. The crawler also honors a Crawl-Delay directive if set by the website owner. However, some webmasters have reported occasional visits to disallowed paths during testing, though these instances are rare and generally follow documented behavior. Overall, daumoa is compliant with the Robots Exclusion Protocol.

🔍 Detection Indicators

The primary User-Agent string is Daumoa/2.0 (e.g., Mozilla/5.0 (compatible; Daumoa/2.0; +https://searchadvisor.daum.net/robots)). Older versions include Daumoa/1.0 and Daum/1.0. The crawler also sends an Accept-Language: ko-KR,ko;q=0.9,en;q=0.8 header, reflecting its Korean origin. Additional fingerprinting includes a lack of cookie persistence and a standard user-agent pattern with the phrase "Daumoa" in the comment field. The bot's IP addresses can be identified via PTR records ending in .crawl.kakao.com.

📊 Data Usage

Collected data is exclusively used for building and updating the Daum Search index, providing search results to users on search.daum.net. This includes page titles, meta descriptions, text content, and link structures. Daum does not use this data for AI training or third-party analytics; it is solely for search engine functionality. The data retention period follows standard search engine practices, with periodic re-crawls to refresh indexed content.

⚙️ Rate Limiting Policy

Daumoa is rate-limited because, while legitimate, it can generate significant traffic if not throttled. Site administrators are advised to use robots.txt with a Crawl-Delay: 10 or similar to manage its request rate. This policy ensures it does not overload servers while still allowing indexing of web content.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.