werelatebot
werelatebot is a legitimate web crawler operated by the WeRelate Foundation, a non-profit organization that runs the collaborative genealogy wiki at www.werelate.org. Its primary purpose is to index publicly available genealogical records, family trees, and historical documents from external websites to feed into the WeRelate database, enabling users to cross-reference and enrich their family history research. The bot was first documented in 2008 and has been consistently updated to respect web standards.
werelatebot performs structured HTTP GET requests at a moderate rate, typically issuing one request every 10 to 30 seconds to avoid overwhelming servers. It crawls primarily on port 80 and 443, following robots.txt directives and respecting Crawl-Delay headers when present. The bot identifies itself through the User-Agent string Mozilla/5.0 (compatible; werelatebot/1.0; +http://www.werelate.org/wiki/WikiNode:Werelatebot) and operates from IP addresses within the range 69.164.196.0/24 (as verified via reverse DNS lookups and WHOIS records). It does not use JavaScript rendering or session cookies, relying solely on static HTML parsing. Traffic logs show consistent, daily crawl patterns originating from a single IP within that subnet, with peak activity during UTC daytime hours.
According to official documentation published on the WeRelate wiki (http://www.werelate.org/wiki/WikiNode:Werelatebot), the bot fully honors Disallow directives in robots.txt and respects Crawl-Delay settings. The WeRelate Foundation explicitly states that webmasters can block the bot entirely by adding User-agent: werelatebot and Disallow: / to their robots.txt, and it will cease crawling immediately without further requests.
The definitive detection signature is the User-Agent string: Mozilla/5.0 (compatible; werelatebot/1.0; +http://www.werelate.org/wiki/WikiNode:Werelatebot). Additionally, the bot's HTTP requests contain a standard Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 header and no Accept-Encoding or Referer fields. The bot's IP address consistently resolves to host-69-164-196-XXX.static.rcable.com, confirming its origin from a specific block.
The collected data—including textual records, dates, names, and links—is ingested into the WeRelate collaborative genealogy database to help users build and verify family trees. WeRelate does not use the data for AI training or commercial purposes; it is purely for open historical research and community contribution. The foundation publishes a public list of crawled sites on its wiki for transparency.
werelatebot is rate-limited because its crawl pattern, while slow, can still generate significant load on smaller genealogy sites with limited bandwidth. Policy recommends blocking only after observing sustained rates exceeding one request every 5 seconds or failure to respect robots.txt directives, which this bot has historically complied with.
Similar Threats
— Imperva Bad Bot Report 2026
How much of your traffic is automated? Get your personal bot traffic report and see exactly what's hitting your server — completely free.
📊 Get My Bot ReportSign up in seconds · No card required
ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.
Stay up to date with the latest from Boteraser.
We use cookies to improve your experience on our site. By using our site, you consent to cookies.
Manage your cookie preferences below:
Essential cookies enable basic functions and are necessary for the proper function of the website.
CloudFlare provides web performance and security solutions, enhancing site speed and protecting against threats.
Service URL: developers.cloudflare.com (opens in a new window)
These cookies are needed for adding comments on this website.
These cookies are used for managing login functionality on this website.
Statistics cookies collect information anonymously. This information helps us understand how visitors use our website.
Google Analytics is a powerful tool that tracks and analyzes website traffic for informed marketing decisions.
Service URL: policies.google.com (opens in a new window)
You can find more information in our Cookie Policy and Privacy Policy.