peer39_crawler User-Agent & Blocking Rules
Operated by Peer39
SEO Tools Caution
What is peer39_crawler?
Peer39's crawler analyzes page content to provide contextual advertising data (brand safety, keywords) for advertisers.
Test if peer39_crawler can access your URL
Enter URL to test if peer39_crawler is allowed or blocked.
Is peer39_crawler Safe?
It is recommended to use caution with peer39_crawler.
This bot may have legitimate uses but can be resource-intensive or used for competitive intelligence.
For more information about our safety badges, visit our documentation.
User-Agent String used by peer39_crawler
peer39_crawlerHow to Block peer39_crawler?
Add the following standard robots.txt rule to prevent peer39_crawler from accessing your site.
User-agent: peer39_crawler Disallow: /