🤖 Overview

Pogodak.ba is a Bosnian-language search engine and web portal operated by Infobiro d.o.o. (Sarajevo) since 2005. Its primary purpose is to index Bosnian, Croatian, Serbian, and regional web content, providing localised search results, news aggregation, and a web directory. The crawler feeds data into Pogodak.ba’s search index, which also powers its “Pogodak Traži” (Search) and “Pogodak Vesti” (News) products.

🌐 Technical Behavior

Pogodak.ba’s crawler, identified via User-Agent strings like Mozilla/5.0 (compatible; Pogodak/1.0; +http://www.pogodak.ba/robot.html), performs standard HTTP GET requests with a default crawl delay of 2–5 seconds per host. It respects robots.txt and uses a crawl queue prioritising .ba, .hr, .rs, .me, and other regional top-level domains. The crawler operates from IP ranges primarily belonging to Infobiro’s ASN (AS213223), with addresses such as 89.146.48.0/24. It supports both HTTP/1.1 and HTTP/2, and sends a custom From header: [email protected]. The crawler does not follow JavaScript-rendered content; it only indexes static HTML, with a maximum crawl depth of 5 levels per site.

📋 robots.txt Compliance

Pogodak.ba’s crawler fully honours Disallow directives as documented on its official robot page (http://www.pogodak.ba/robot.html). It also respects Crawl-Delay directives in robots.txt, with a typical default of 5 seconds. The bot’s compliance has been verified by site administrators; it does not bypass disallowed paths or ignore nofollow tags. However, no Court rulings or formal complaints have been filed regarding non-compliance, suggesting consistent adherence.

🔍 Detection Indicators

Primary User-Agent: Mozilla/5.0 (compatible; Pogodak/1.0; +http://www.pogodak.ba/robot.html) (also variants with “Pogodak/2.0” for newer builds). Behavioural fingerprints include a consistent request pattern: the crawler always fetches robots.txt first, then requests pages in lexical URL order. It sends a custom HTTP header X-Pogodak-Crawl: 1 in all requests, and the From header is set to [email protected]. No other identifying cookies are used. The crawler does not send referrers.

📊 Data Usage

Collected data is used exclusively to populate and refresh the Pogodak.ba search index, which serves users from Bosnia, Croatia, Serbia, and Montenegro. The index powers localised search results, news snippets, and the directory listing on the portal. Data is not sold to third parties or used for AI training; it is retained for up to 90 days after last crawl, then purged. Infobiro d.o.o. states in its privacy policy that crawled content is only used to improve search relevance and to generate aggregate statistics (e.g., page popularity).

⚙️ Rate Limiting Policy

Pogodak.ba’s crawler is rate-limited because, despite being legitimate, its moderate crawl speed (2–5 requests per second) can still overwhelm smaller shared hosting environments. Administrators are recommended to limit the bot to 1 request per 2 seconds using a threshold-based blocking rule (e.g., via .htaccess or Nginx rate limiting) to ensure server stability without blocking the bot entirely.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.