🤖 Overview

BuscaPlus Robi is the web crawler operated by the Spanish metasearch engine BuscaPlus, launched in 2005. Its purpose is to index publicly accessible web content for inclusion in BuscaPlus search results, aggregating data from multiple sources. The bot is maintained by BuscaPlus’s internal team, and official documentation is available at ayuda.buscaplus.com/crawler.

🌐 Technical Behavior

Robi uses a breadth‑first crawl strategy, starting from a seed list of high‑authority Spanish domains. Request frequency averages one every 3 seconds per host but can burst to 10 requests per second during re‑crawls. The bot communicates via HTTP/1.1 and HTTP/2, and includes a From header with the email [email protected]. Its known IP ranges include 185.89.100.0/22 (AS12334, Spain). Robi respects nofollow link attributes and supports index and follow meta tags, as per BuscaPlus’s technical notes.

📋 robots.txt Compliance

BuscaPlus explicitly states in its crawler policy that Robi obeys the Robots Exclusion Protocol. It honors both Disallow directives and Crawl-Delay instructions; verification from live robots.txt files shows no violations. Robi pauses for the exact delay specified before issuing further requests.

🔍 Detection Indicators

The primary User‑Agent string is Mozilla/5.0 (compatible; BuscaPlus Robi/1.0; +https://buscaplus.com/robot) with version suffixes. Additional headers include Via and X-Bot: true. Behavioral fingerprints include an initial HEAD request preceding every GET, and session durations under 30 seconds per domain.

📊 Data Usage

Collected data feeds exclusively into the BuscaPlus search index, which is updated every 48 hours for priority sites. BuscaPlus’s privacy policy confirms that crawled content is not used for AI training, advertising, or third‑party analytics. The index is keyword‑based and prioritises Spanish‑language content.

⚙️ Rate Limiting Policy

Rate‑limiting Robi is recommended because its burst traffic can overwhelm small servers. BuscaPlus advises a threshold of 30 requests per minute per IP, triggering a 503 response if exceeded, as documented in their rate‑limiting guidelines at ayuda.buscaplus.com/rate-limit.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.