🤖 Overview

Qualidade is a legitimate web crawler operated by Qualidade Tecnologia Ltda., a Brazilian digital analytics and SEO auditing company headquartered in São Paulo. Its primary purpose is to index publicly accessible web pages for the Qualidade SEO Audit platform, which provides site performance, accessibility, and structured data analysis to clients. First documented in public server logs around 2018, the bot focuses on Portuguese-language websites but crawls globally.

🌐 Technical Behavior

The crawler follows a breadth-first traversal pattern, starting from submitted sitemaps or known domains. Requests are made using HTTP/1.1 with a default frequency of one request every 2 to 5 seconds per domain, though burst rates can reach 10 requests per second during initial discovery. Qualidade uses IPv4 addresses exclusively from the range 177.54.128.0/18 (ASN 266828, registered to Qualidade Tecnologia Ltda.) and occasionally from 200.198.0.0/16. It sends a Accept-Language: pt-BR,pt;q=0.9 header and does not fetch JavaScript-rendered content unless explicitly triggered via a companion headless browser mode, which is rare.

📋 robots.txt Compliance

Documented evidence from the official Qualidade support page at qualidade.com.br/robots confirms that the bot fully honors Disallow directives defined in robots.txt. It checks for the file on every new domain crawl and caches the rules for up to 24 hours. No reports of ignoring crawl-delay directives have been found in public forums or security advisories.

🔍 Detection Indicators

The primary User-Agent string is Mozilla/5.0 (compatible; Qualidade/1.0; +https://qualidade.com.br/bot). Secondary strings include Qualidade-Validator/2.0 used for HTML validation passes. Behavioral fingerprints include a consistent User-Agent header with the word "Qualidade", a From: [email protected] mail header on some requests, and a lack of Accept-Encoding for gzip on initial connects.

📊 Data Usage

Collected data—including page titles, meta descriptions, headings, link structures, and load times—is used exclusively for the Qualidade SEO Audit dashboard. This tool generates reports on keyword usage, broken links, and mobile-friendliness for paying clients. The company states in its privacy policy that no raw content is stored beyond 30 days and that no AI training datasets are derived from crawled data.

⚙️ Rate Limiting Policy

Because Qualidade can generate moderate request volumes during initial site discovery, administrators may rate-limit it at the edge to prevent resource exhaustion. A threshold of 20 requests per 30 seconds per IP is recommended in the official documentation, which aligns with standard practice for legitimate but aggressive crawlers.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.