Helps developers reference your documentation through AI tools.
Recommended action: Allow access, especially for documentation and API pages.
Category
AI Coding Agent
Primary use case
Developer documentation
Trust level
Generally safe
Trust Levels
- Trusted
- Generally safe
- Review recommended
- Caution advised
Trust levels are an indication based on category, operator, and robots.txt compliance. Always review bot activity for your specific situation.
Learn how we assess trustrobots.txt
Respected
Devin Traffic (Last 90 Days)
Not enough network data yet.
Track this bot on your siteWhat is Devin?
Devin is a software engineering AI assistant by Cognition that can browse websites and perform web-based tasks, functioning as a collaborative AI teammate for engineering teams.
What Devin means for your site
Devin visits your pages when a developer uses an AI coding assistant that references your documentation or technical content, operated by Cognition. If you publish APIs, developer docs, or technical guides, these visits mean your content is directly helping developers build software.
What should you do?
- Allow Devin access, especially for documentation pages
- Ensure API docs and technical guides are well-structured
- Monitor which documentation pages are most referenced
See Devin on your own site
BotSights tracks every Devin visit in real time, including which pages it crawls, how often, and from where.
How to identify Devin
Devin uses the user-agent "Devin" and respects robots.txt.
DevindevinHow to block Devin
Three robots.txt options below. Pick the one that matches your goal. Each snippet lists every known Devin user-agent pattern so the rules apply regardless of which one the bot announces.
Edit robots.txt with care
A single misplaced line can de-index your entire site. Common mistake: pasting User-agent: * followed by Disallow: / blocks every bot, not just Devin, including Googlebot. Always paste the snippet between existing rules (not over them), keep the User-agent line scoped to Devin's patterns, and verify with Google's robots.txt tester before deploying. If you are not sure, ask a developer first.
Option 1: Block all access
Tells Devin not to crawl any URL on your site. Use this when you want the bot completely off your content.
User-agent: Devin
User-agent: devin
Disallow: /Option 2: Block specific paths only
Keep public content crawlable but exclude sensitive or non-public sections. Add one Disallow: line per path. Replace the example paths with your own.
User-agent: Devin
User-agent: devin
Disallow: /admin/
Disallow: /private/
Disallow: /checkout/Option 3: Slow down with a crawl delay
Crawl-delay is a voluntary directive that asks the bot to wait the given number of seconds between requests. Useful when Devin is hammering your origin and slowing the site down for real visitors, but you do not want to block it outright. The value is in seconds, so 10 means at most one request every ten seconds. Not all bots honour this directive (Googlebot ignores it; Bingbot, Yandex, and many AI crawlers do respect it).
User-agent: Devin
User-agent: devin
Crawl-delay: 10Frequently Asked Questions
What is the User-Agent for Devin?
Devin identifies itself with the User-Agent string "Devin" (alternate forms: devin). Use this in robots.txt or server-side filters.
Why is Devin accessing my documentation?
A developer is using an AI coding assistant that pulled in your docs to help generate or explain code. Each visit means your technical content is actively shaping a developer's work — a strong signal for the value of your documentation.
Which pages does Devin typically access?
Devin most often hits API references, code examples, getting-started guides, and error-message documentation. Pages with clear code blocks, type signatures, and concise explanations get pulled in most.
Should I block Devin?
If you publish developer documentation, blocking reduces your reach through AI coding tools. Most docs sites benefit from being accessible — your content becomes part of how developers solve problems with AI assistance, which feeds back into adoption of your product or library.
How do I optimize my docs for Devin?
Structure beats prose. Use clear headings, code blocks with language hints (```typescript), explicit type signatures, and short paragraphs. Avoid hiding key information behind tabs or accordions that the bot might not render.
See how AI coding tools use your documentation
Track when AI coding assistants reference your docs and APIs, and understand which technical content matters most.
- Documentation access tracking
- See which AI coding tools reference your content
- Understand your developer audience better
Free plan available. No credit card required. Setup in 2 minutes.