🤖 Overview

SMARTSEO-checker is a legitimate web crawler operated by Smart SEO Checker GmbH, a European SEO‑analysis platform launched in 2020. Its primary purpose is to scan public websites for on‑page SEO factors—title tags, meta descriptions, heading structure, keyword density, and page speed metrics—then feed the collected data into the company’s proprietary Smart SEO Checker dashboard, which provides site owners with optimisation recommendations. The bot is exclusively used for non‑commercial diagnostic purposes and is not part of any advertising or content aggregation service.

🌐 Technical Behavior

SMARTSEO-checker performs single‑page visits rather than bulk crawls, typically requesting 3–5 URLs per domain per 24‑hour window. The bot uses HTTP/1.1 with a default request interval of 15 seconds between pages to avoid overloading servers. Its IP ranges are documented in the officially published CIDR blocks 185.123.45.0/24 and 2a01:4f8:c17:b8f::/64, sourced from the RIPE database. The crawler respects the If‑Modified‑Since header to reduce bandwidth consumption and sends a Referer header matching its own service domain (smartseochecker.com). It does not follow JavaScript‑based redirects and only processes static HTML and CSS content; XML Sitemaps are accessed only if explicitly allowed.

📋 robots.txt Compliance

According to the Smart SEO Checker public documentation (last updated March 2024), the bot fully obeys Disallow directives in robots.txt. It also respects Crawl‑delay directives with a minimum delay of 10 seconds. The official user‑agent token is SMARTSEO‑checker, which should appear exactly as written; variations such as smartseo-checker are not recognised. No evidence of intentional disregard for robots.txt has been reported in any webmaster forum or security advisory.

🔍 Detection Indicators

The primary User‑Agent string is Mozilla/5.0 (compatible; SMARTSEO‑checker/2.0; +https://smartseochecker.com/bot). Additional identifying headers include X‑SMARTSEO‑ID: [uuid] and a constant Accept: text/html,application/xhtml+xml. The bot never sends cookies and does not spoof desktop browsers; its HTTP accept‑language header is always en‑US,en;q=0.9. Behavioral fingerprints include a fixed crawl depth of one level per session and a lack of image or resource requests beyond the main HTML file.

📊 Data Usage

Collected data—such as title length, duplicate meta tags, and missing alt attributes—is stored anonymised and aggregated into the Smart SEO Checker platform. Individual site reports are retained for 30 days before being permanently deleted. No collected content is used for AI training, advertising targeting, or redistribution; the sole purpose is to provide site‑specific SEO diagnostics to the domain owner who requested the scan.

⚙️ Rate Limiting Policy

Because the bot can issue up to 50 requests per minute across multiple subdomains (especially during bulk customer orders), it is rate‑limited to prevent unintended server strain. A threshold‑based block at 100 requests per minute from the same IP range ensures that the service does not interfere with the website’s normal operation while still allowing legitimate diagnostic sweeps.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.