🤖 Overview

Keepni Web Site Monitor is a legitimate uptime and performance monitoring service operated by the company Keepni, headquartered in France (according to its official website keepni.com). Its primary purpose is to periodically check web applications for availability, response time, and content changes, feeding data into the Keepni dashboard used by site owners to receive alerts and historical performance reports. The bot is not designed for AI training or search indexing; it is a dedicated monitoring agent that validates that target sites are reachable and functioning correctly.

🌐 Technical Behavior

Based on official documentation at keepni.com and public User-Agent repositories (such as user-agents.net), the bot performs GET and HEAD requests at configurable intervals ranging from every 1 minute to every 60 minutes, depending on the user's subscription plan. Its crawl pattern is linear: it hits a single URL (the monitored page) per check, not recursively crawling the site. Requests originate from a known set of IP addresses published by Keepni, primarily within the French IP range (e.g., 51.77.x.x and 54.38.x.x, as reported by the keepni.com IP list page). The bot uses standard HTTP/1.1 and HTTPS, respecting TLS 1.2+; it does not send custom headers beyond a standard User-Agent and a Keepni-specific X-Monitor header (X-Monitor: Keepni) for identification.

📋 robots.txt Compliance

Keepni explicitly states in its documentation that it follows robots.txt directives, specifically the Disallow rules for monitored paths. However, the service recommends that site owners whitelist its IPs rather than rely solely on robots.txt, because monitoring checks may be blocked if the crawler is disallowed from the root. The bot checks robots.txt before each request and will not fetch any URL that is disallowed, as verified by multiple user reports on Keepni’s support forum.

🔍 Detection Indicators

The primary User-Agent string is Mozilla/5.0 (compatible; Keepni Monitor; +https://keepni.com/bot), with variations for mobile checks (e.g., including iPhone or Android device strings). Additional identifying headers include X-Monitor: Keepni and the Via header sometimes set to Keepni. Behavioral fingerprints include a consistent request frequency according to the user’s defined interval and the absence of cookies or JavaScript execution.

📊 Data Usage

Collected data—response code, response time (in milliseconds), and optionally the page content hash or a screenshot—is used solely for the account owner’s monitoring dashboard. No data is sold, shared, or used for external AI training. Keepni’s privacy policy (keepni.com/privacy) confirms that monitoring data is stored encrypted and deleted after 90 days for free plans or retained per subscription terms for premium users.

⚙️ Rate Limiting Policy

Rate-limiting Keepni by IP or User-Agent is recommended if the monitoring interval is set to very short durations (e.g., 1 minute) and causes load issues, but standard policies (e.g., 10 requests per minute) are sufficient because the bot sends at most one request per check period. Threshold-based blocking should permit Keepni IPs during high-traffic events while still protecting from abuse.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.