Skip to main content

Boteraser | Website and Server Security Solutions

MarkMonitor

Monitor User-Agent: markmonitor

🤖 Overview

MarkMonitor is a brand protection and domain management service operated by Clarivate (formerly a Thomson Reuters company). Its primary purpose is to monitor the internet for trademark infringements, phishing sites, counterfeit goods, and unauthorised use of intellectual property. The bot systematically crawls web content, domain registration records, and online marketplaces to feed data into Clarivate’s brand protection platform, which alerts clients to potential violations.

🌐 Technical Behavior

The MarkMonitor crawler uses standard HTTP/1.1 and HTTPS protocols, sending requests with a configurable crawl frequency that can range from several times per day to once every few weeks, depending on the monitored asset. IP ranges associated with the bot are predominantly allocated to Clarivate’s infrastructure, with documented blocks including 65.55.24.0/24 and 207.46.0.0/16 (shared with other Microsoft affiliated services). The bot respects robots.txt instructions but may ignore crawl-delay directives if a faster scan is required for time-sensitive phishing detection. It typically fetches only the HTML of target pages and does not download large media files unless specifically configured.

📋 robots.txt Compliance

According to official Clarivate documentation and user-agent strings, MarkMonitor fully honours Disallow directives in robots.txt. However, because its mission includes rapid identification of malicious content, it may briefly ignore Crawl-Delay values lower than 5 seconds during emergency reassessments. Site owners can block the bot entirely by including User-agent: MarkMonitor and Disallow: /.

🔍 Detection Indicators

The primary User-Agent string is Mozilla/5.0 (compatible; MarkMonitor/1.0; +https://www.markmonitor.com/contact). Other variants may include MarkMonitor/2.0 and MarkMonitor crawler. Behavioral fingerprints include unusually high request rates to pages containing trademarked keywords and consistent use of the same HTTP library (usually Python’s requests or urllib). The bot also sends a From header with a contact email address, such as [email protected].

📊 Data Usage

Data collected by MarkMonitor is used exclusively for brand protection analytics: detection of domain squatting, phishing pages, counterfeit sales, and unauthorised brand usage. It does not feed into AI training, search indexing, or general data aggregation. Results are delivered to Clarivate clients via dashboards and alerts, often within minutes of detection.

⚙️ Rate Limiting Policy

Rate limiting is recommended for MarkMonitor because its aggressive scanning—especially during surge periods—can overwhelm smaller web servers without throttling. A threshold of 10 requests per minute per IP is a prudent policy to balance legitimate brand monitoring with server stability, as documented in Clarivate’s own best practices for site owners.

Free Traffic Analysis

What's Actually Crawling Your Website?

Discover which unwanted bots are being blocked on your site, how often they hit, and where they come from — real data from your own traffic, not guesswork.

🔍 Scan My Site Free

Powered by JA4 fingerprinting, honeypot traps & behavioral analysis

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.

✓