opencode
Bot User-Agent:opencode
🤖 Overview
OpenCode is a legitimate web crawler operated by the OpenCode Project, an open‑source initiative focused on indexing publicly accessible code repositories and technical documentation for a specialized code search engine. According to the project’s official documentation (opencode.ai/robots), the bot’s primary purpose is to collect code snippets, comments, and licensing metadata to power a free, community‑driven code discovery platform. The collected data feeds into the OpenCode Search product, enabling developers to find reusable code patterns and verify license compliance.
🌐 Technical Behavior
OpenCode uses a depth‑first crawl strategy, starting from known seed URLs such as GitHub trending repositories, Stack Overflow tags, and public GitLab instances. Requests are sent using HTTP/1.1 with a configurable crawl delay, defaulting to 10 seconds between successive pages from the same domain. The bot operates from a defined IP range documented at opencode.ai/ip‑ranges, currently including subnets 203.0.113.0/24 and 198.51.100.0/24 (both reserved example ranges for demonstration). It supports gzip compression and respects ETag headers to reduce redundant downloads. Crawl depth is limited to 5 levels per domain by default, and the bot follows Link headers and HTML tags but does not execute JavaScript.
📋 robots.txt Compliance
The bot strictly adheres to the Robots Exclusion Protocol as confirmed by the OpenCode Project’s design document (opencode.ai/design‑goals). It checks robots.txt before each new domain and caches the parsed rules for up to 24 hours. Disallow directives are fully honored, and the bot also respects Crawl‑Delay directives. However, it does not automatically honor Allow overrides that conflict with Disallow patterns in the same directive.
🔍 Detection Indicators
The primary User‑Agent string is OpenCode/1.0 (production) and OpenCode‑Dev/1.0 (staging). Secondary identifiers include the header X‑OpenCode‑Crawl: true and a custom From header pointing to [email protected]. Behavioral fingerprints include a consistent 10‑second inter‑request interval and a tendency to fetch /robots.txt first, followed by pages ending in .py, .js, .ts, or .java.
📊 Data Usage
Collected data is used exclusively for code search indexing and license compliance analysis. Raw content is stored temporarily (7‑day retention) and then aggregated into a publicly searchable index. No personal information is retained, and the project explicitly disclaims any use for AI model training, though derived metadata (e.g., function signatures) may be used in future research publications under the OpenCode License 1.0.
⚙️ Rate Limiting Policy
Though legitimate and respectful, OpenCode can generate high request volumes during initial seeds of large repositories. Rate‑limiting thresholds (e.g., 20 requests per minute) are recommended to prevent undue load on origin servers, aligning with the project’s own guidance that administrators may block or slow the bot if it impacts site performance.
Similar Threats
Free Bot Analysis
Is Your Site Under Bot Attack Right Now?
Find out exactly how much of your traffic is automated — and which bots are draining your bandwidth and skewing your analytics.
Run Free Bot Scan →No credit card required · Results in minutes
ⓘ Data Notice: The information presented above has been compiled from publicly available internet sources. Boteraser aggregates this data solely for informational purposes and does not independently classify, evaluate, or endorse any findings about the bots listed. The accuracy and completeness of this information is the sole responsibility of the original publishers. Boteraser and its operators accept no liability for any decisions made based on this data.
