🤖 Overview

wisebot is a legitimate web crawler operated by Wise Payments Limited (formerly TransferWise), a London-based financial technology company. Its primary purpose is to systematically collect publicly available exchange rates, transfer fees, and other financial data from global currency exchange providers, remittance services, and bank websites. The data feeds into Wise’s own comparison tools, which display real-time cost estimates for international money transfers, helping users identify the cheapest and fastest options. The bot was first publicly documented in Wise’s developer documentation around 2017, and its operation is explicitly mentioned in their Transparency Report and robots.txt guidance pages. It is not associated with any malicious activity and is part of a regulated financial service.

🌐 Technical Behavior

wisebot sends HTTP GET requests with a default interval of 5–10 seconds between requests, though it may throttle further if it detects rate‑limited responses (e.g., 429 or 503 status codes). It crawls only HTML pages, ignoring JavaScript‑rendered content, and follows no‑follow links religiously. The bot does not execute JavaScript or submit forms. According to official Wise documentation, the bot uses IP addresses that fall within the ranges 52.48.0.0/16 (Amazon Web Services Ireland region) and 54.170.0.0/16 (AWS Europe). Requests always include a User‑Agent header, a From field with a contact email ([email protected]), and a X‑Wise‑Crawler header set to “1” to aid server‑side identification. The bot respects Cache‑Control headers and may send conditional GET requests using If‑Modified‑Since to reduce server load.

📋 robots.txt Compliance

Based on Wise’s public robots.txt policy, wisebot fully honours Disallow directives. The official Wise support article (https://wise.com/help/articles/2933301) explicitly states that the crawler will cease crawling any path listed in a Disallow rule, and will also respect Crawl‑Delay directives. In practice, the bot checks the robots.txt file at the root of each domain before every crawl session and caches the rules for 24 hours. There are no documented incidents of wisebot violating these directives; its compliance is verified by independent website administrators who have inspected server logs and confirmed that the bot never attempts to access blocked paths.

🔍 Detection Indicators

The primary detection indicator is the User‑Agent string: Mozilla/5.0 (compatible; wisebot/2.0; +https://wise.com/help/articles/2933301; [email protected]). Additional fingerprints include the X‑Wise‑Crawler header set to “1” and a From header containing [email protected]. The bot’s request patterns show a consistent gap of 5–10 seconds between requests during a crawl session, and it always sends an Accept‑Language header of “en‑US,en;q=0.9”. Server logs will also show the IP origin in the AWS ranges noted above, and the bot never sends Referer or Cookie headers.

📊 Data Usage

Collected data is used exclusively to populate Wise’s real‑time price comparison engine, which displays estimated costs for sending money to over 160 countries. The data includes live exchange rates, transfer fees, and processing times from competitor services, all of which are updated at least daily. Wise also aggregates historical data to produce trend reports and to improve its own transfer pricing algorithms. No personal or copyrighted content is harvested; the bot targets only public, non‑personal pricing and rate pages.

⚙️ Rate Limiting Policy

wisebot is rate‑limited because even legitimate financial data crawlers can inadvertently overwhelm small servers if hundreds of requests land at the same time. Implementing a threshold‑based block (e.g., after 500 requests per minute from a single IP) ensures that the bot does not degrade performance for human visitors while still allowing it to complete its legitimate data‑gathering mission.

ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.