cohere-training-data-crawler User-Agent & Blocking Rules
Operated by Cohere
AI Bots Caution
What is cohere-training-data-crawler?
Explicitly named crawler by Cohere for gathering training datasets for their Large Language Models.
Test if cohere-training-data-crawler can access your URL
Enter URL to test if cohere-training-data-crawler is allowed or blocked.
Is cohere-training-data-crawler Safe?
It is recommended to use caution with cohere-training-data-crawler.
This bot may have legitimate uses but can be resource-intensive or used for competitive intelligence.
For more information about our safety badges, visit our documentation.
User-Agent String used by cohere-training-data-crawler
cohere-training-data-crawlerHow to Block cohere-training-data-crawler?
Add the following standard robots.txt rule to prevent cohere-training-data-crawler from accessing your site.
User-agent: cohere-training-data-crawler Disallow: /