Googlebot User-Agent & Blocking Rules
Operated by Google
Search Engines Safe
What is Googlebot?
Googlebot is Google's primary web crawling bot. It discovers and indexes new and updated pages to be added to the Google Search index. Blocking this bot will remove your site from Google Search results.
Test if Googlebot can access your URL
Enter URL to test if Googlebot is allowed or blocked.
Is Googlebot Safe?
Yes, Googlebot is considered safe.
This bot is verified and generally respected by the SEO community.
For more information about our safety badges, visit our documentation.
User-Agent String used by Googlebot
GooglebotHow to Block Googlebot?
Add the following standard robots.txt rule to prevent Googlebot from accessing your site.
User-agent: Googlebot Disallow: /