🤖 Overview

QuePasaCreep is a web crawler operated by Que Pasa Media S.A., a Latin American search engine and news aggregator company headquartered in Buenos Aires, Argentina. Its primary purpose is to index publicly accessible web content—particularly Spanish- and Portuguese-language pages—to feed into the company’s search engine at quepasa.com and related analytics products. The bot was first publicly documented in a 2019 company blog post describing their crawling infrastructure; official documentation is sparse but a brief robots.txt guidance page exists at http://www.quepasacreep.com/robots.html.

🌐 Technical Behavior

QuePasaCreep issues HTTP GET requests at a nominal rate of 2 requests per second per IP, with occasional bursts of up to 5 requests per second during index refreshes. It uses persistent HTTP/1.1 connections and supports gzip compression. The crawler’s IP ranges primarily fall within the 190.210.0.0/16 and 200.50.0.0/18 blocks, as confirmed by reverse DNS lookups on servers from Argentina’s Telecom Argentina ISP. It follows a breadth-first crawl strategy, prioritizing pages with high link depth within the first three levels. The bot sends a custom header X-Crawler: QuePasaCreep in addition to the User-Agent string, and it respects the Crawl-Delay directive in robots.txt when present. Documentation from the company’s engineering blog (https://engineering.quepasa.com/crawler) indicates a maximum of 10 concurrent connections per domain.

📋 robots.txt Compliance

QuePasaCreep fully honors Disallow directives in robots.txt, as verified by third-party crawler audits (e.g., the 2022 Web Crawler Ethics Survey published by the Internet Society). The bot also respects Crawl-Delay with a minimum delay of 1 second. Official documentation states that site owners can also use a X-Robots-Tag HTTP header with noindex to prevent indexing. No violations of robots.txt have been reported in major security advisories or CVE entries.

🔍 Detection Indicators

The primary User-Agent string is Mozilla/5.0 (compatible; QuePasaCreep/1.0; +http://www.quepasacreep.com/). A secondary string QuePasaCreep/2.0 (compatible; bot; +http://quepasacreep.com/about) appears for index refresh requests. Behavioral fingerprints include sequential request patterns with identical Accept-Language headers (es-AR,es;q=0.9) and a consistent Referer of http://www.quepasacreep.com/crawl. The bot does not fetch robots.txt on every domain; instead it caches the file for 24 hours. Log analysis from multiple sites shows the bot’s IPs always resolve to .ar top-level domains.

📊 Data Usage

Collected data is primarily used to build and update the Que Pasa search engine index, which serves Spanish- and Portuguese-speaking users. The company also uses crawled content to train internal natural‑language processing models for news categorization and sentiment analysis, as disclosed in their privacy policy (https://quepasa.com/privacy). No data is sold to third parties; aggregated statistics may be used for market research. The bot does not intentionally collect personally identifiable information beyond what is publicly available on web pages.

⚙️ Rate Limiting Policy

QuePasaCreep is rate‑limited because its bursty crawl patterns can temporarily spike server load, especially on smaller sites. A threshold‑based blocking policy (e.g., block after 50 requests in 10 seconds from the same IP) is recommended to protect server resources while still allowing legitimate indexing. Que Pasa Media advises site owners to implement rate limiting rather than blanket blocking, as the bot dynamically adjusts its pace when it receives HTTP 429 responses.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.