ClaudeBot User-Agent & Blocking Rules
Operated by Anthropic
AI Bots Safe
What is ClaudeBot?
The main crawler for Anthropic. It scrapes the web to build the training dataset for the Claude family of AI models.
Test if ClaudeBot can access your URL
Enter URL to test if ClaudeBot is allowed or blocked.
Is ClaudeBot Safe?
Yes, ClaudeBot is considered safe.
This bot is verified and generally respected by the SEO community.
For more information about our safety badges, visit our documentation.
User-Agent String used by ClaudeBot
ClaudeBotHow to Block ClaudeBot?
Add the following standard robots.txt rule to prevent ClaudeBot from accessing your site.
User-agent: ClaudeBot Disallow: /