Twitterbot User-Agent & Blocking Rules
Operated by X (Twitter). Verify the official user-agent string and safety status for this bot. Use the tools below to run a live crawlability test and get copy-paste robots.txt rules to manage its access. Crawler info last updated on .
What is Twitterbot?
Twitterbot (now X) fetches content to generate 'Cards' (previews) when links are posted on the X platform.
Test if Twitterbot can access your URL
Enter URL to test if Twitterbot is allowed or blocked.
Is Twitterbot safe?
Yes, Twitterbot is considered safe.
This bot is verified and generally respected by the SEO community.
For more information about our safety badges, visit our documentation.
User-Agent String used by Twitterbot
TwitterbotHow to block Twitterbot with robots.txt?
Add the following standard robots.txt rule to prevent Twitterbot from accessing your site.
User-agent: Twitterbot Disallow: /
What happens if I block Twitterbot?
Medium Impact
Blocking Twitterbot may prevent proper link previews when your content is shared on social media platforms. This could affect how your links appear when shared, but won't impact search rankings.
Common use cases for Twitterbot
Understanding how Twitterbot is typically used can help you make informed decisions about whether to allow or block it on your website.
- Generates link previews for social media shares
- Fetches Open Graph and Twitter Card metadata
- Creates rich snippets when links are posted
- Validates and displays website thumbnails
- Improves user experience on social platforms