usage-ai-training
__usage_ai-training is not a publicly documented web crawler User-Agent or a vendor-named bot; no official documentation, GitHub repository, security advisory, CVE entry, Wikipedia article, or operator page defines it as an automated agent. The string instead resembles an internal usage-class label for AI-training permissions, similar to tokens discussed in robots.txt and IETF AIPREF content-usage proposals, rather than a crawler with an owner or product pipeline. Consequently, there is no verifiable operator, crawl purpose, or downstream AI product to attribute.
No published request pattern, crawl frequency, IP range, protocol behavior, or authentication scheme is associated with __usage_ai-training because it has not been documented as a live crawler. Public bot inventories such as the GitHub ai-robots-txt/ai.robots.txt list and vendor User-Agent directories enumerate named agents such as GPTBot, ClaudeBot, CCBot, and Bytespider, but not this identifier. Any traffic logged with this value should be treated as a custom or misconfigured client string until independently verified against source IP and reverse DNS. It should not be mapped to a known crawl infrastructure from this token alone. The absence of ASN, PTR, or published range data means behavioral profiling must rely on request rate, path scope, header order, and TLS fingerprints observed locally.
Because __usage_ai-training is not a documented crawler, there is no verifiable evidence that it honors Disallow directives, Crawl-delay, or newer content-usage signals. The token’s “usage_ai-training” suffix suggests it may represent a policy class rather than a client that fetches robots.txt. Site owners should not assume compliance from the name, and should log whether requests retrieve robots.txt before protected paths.
The only known indicator is the literal string __usage_ai-training; no official User-Agent product token, verification header, or published IP list accompanies it. Detection should combine the string with source-IP reputation, reverse DNS, ASN ownership, and request fingerprints. A matching User-Agent alone is weak evidence because clients can set arbitrary strings.
No public source confirms that data collected under this identifier is used for AI training, search indexing, analytics, or model evaluation. The phrase “ai-training” indicates an intended usage category, not proof of collection or training. Treat any observed data use as unverified unless the operator publishes a purpose, retention policy, and opt-out mechanism.
Rate limiting is still appropriate because unverified clients can consume capacity and evade simple reputation controls; threshold-based blocking should be based on observed request rate and resource impact rather than the label alone.
Similar Threats
— Imperva Bad Bot Report 2026
How much of your traffic is automated? Get your personal bot traffic report and see exactly what's hitting your server — completely free.
📊 Get My Bot ReportSign up in seconds · No card required
ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.
Stay up to date with the latest from Boteraser.
We use cookies to improve your experience on our site. By using our site, you consent to cookies.
Manage your cookie preferences below:
Essential cookies enable basic functions and are necessary for the proper function of the website.
CloudFlare provides web performance and security solutions, enhancing site speed and protecting against threats.
Service URL: developers.cloudflare.com (opens in a new window)
These cookies are needed for adding comments on this website.
These cookies are used for managing login functionality on this website.
Statistics cookies collect information anonymously. This information helps us understand how visitors use our website.
Google Analytics is a powerful tool that tracks and analyzes website traffic for informed marketing decisions.
Service URL: policies.google.com (opens in a new window)
You can find more information in our Cookie Policy and Privacy Policy.