anthropic-ai User-Agent & Blocking Rules
Operated by Anthropic. Verify the official user-agent string and safety status for this bot. Use the tools below to run a live crawlability test and get copy-paste robots.txt rules to manage its access. Crawler info last updated on .
What is anthropic-ai?
A legacy or alternative user-agent string associated with Anthropic's data collection efforts.
Test if anthropic-ai can access your URL
Enter URL to test if anthropic-ai is allowed or blocked.
Is anthropic-ai safe?
Yes, anthropic-ai is considered safe.
This bot is verified and generally respected by the SEO community.
For more information about our safety badges, visit our documentation.
User-Agent String used by anthropic-ai
anthropic-aiHow to block anthropic-ai with robots.txt?
Add the following standard robots.txt rule to prevent anthropic-ai from accessing your site.
User-agent: anthropic-ai Disallow: /
What happens if I block anthropic-ai?
Low Impact
Blocking anthropic-ai will only prevent AI training on your content. This will NOT affect your search engine rankings or website traffic. Safe to block if you want to opt-out of AI training.
Common use cases for anthropic-ai
Understanding how anthropic-ai is typically used can help you make informed decisions about whether to allow or block it on your website.
- Collects web content for AI model training
- Gathers data to improve language understanding
- Scrapes text, code, and other content for datasets
- May be used for chatbot and AI assistant development
- Typically does NOT affect search engine rankings