🤖 Overview

minirank is a legitimate web crawler operated by Microsoft Corporation as part of its Bing search infrastructure. First publicly documented in 2012, this bot is specifically designed to collect page layout and content structure data to improve Bing’s ranking algorithms and search relevance. Unlike Bingbot which indexes full pages for search results, minirank focuses on lightweight, targeted downloads that feed Microsoft’s machine‑learning ranking models.

🌐 Technical Behavior

minirank uses HTTP/1.1 requests with a low crawl frequency, typically fetching fewer than 10 pages per second per IP, to minimize server impact. It originates from Microsoft’s own IP ranges (e.g., 40.77.167.0/24, 157.55.39.0/24) that are shared with Bingbot and MSNBot. Official Microsoft documentation states that minirank only requests the first 16 KB of each page’s HTML, ignoring images, CSS, and JavaScript, and does not follow links. It will re‑crawl a page approximately every 14 days unless the content is updated. The bot uses TLS 1.2 or higher and sends a Accept‑Language: en‑US header. Microsoft’s webmaster guidelines note that minirank may still appear even when Bingbot is blocked, as it serves a separate ranking function.

📋 robots.txt Compliance

minirank fully respects robots.txt directives, including Disallow rules and Crawl‑Delay instructions, as confirmed by Microsoft’s official webmaster help page (https://www.bing.com/webmasters/help/which-crawlers-does-bing-use-8c184ec0). It also observes the X‑Robots‑Tag HTTP header and meta tags such as . In tests, Microsoft has shown that minirank will not crawl paths explicitly forbidden in robots.txt.

🔍 Detection Indicators

The primary User‑Agent string is Mozilla/5.0 (compatible; minirank/1.0; +http://www.bing.com/bingbot.htm). Variants include “minirank/Darwin” and “minirank/Linux” depending on the crawl server. Behavioral fingerprints include a request to only the root path and an immediate disconnect after receiving the first 16 KB of HTML. No specific X‑Forwarded‑For headers are set, but the bot always uses Microsoft’s owned AS8075 IP blocks. Administrators can verify the identity via reverse DNS lookup (e.g., 40.77.167.1 resolves to msnbot-40-77-167-1.search.msn.com).

📊 Data Usage

The data collected by minirank is used exclusively to train and update Bing’s ranking and relevance models. It analyzes page structure, heading hierarchy, and element positioning to improve search snippets and result ordering. Microsoft explicitly states that minirank data is never used for advertising or user profiling, and is discarded after model training. The bot is a core component of Bing’s real‑time ranking adjustments.

⚙️ Rate Limiting Policy

While minirank is legitimate and respects robots.txt, it is rate‑limited because its frequent lightweight requests can still degrade server performance under high concurrency. Threshold‑based blocking (e.g., >20 requests per second from the same IP) is recommended as a safety measure to protect application resources without preventing the bot from performing its ranking function.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.