meta-webindexer User-Agent & Blocking Rules
Operated by Meta. Verify the official user-agent string and safety status for this bot. Use the tools below to run a live crawlability test and get copy-paste robots.txt rules to manage its access. Crawler info last updated on .
What is meta-webindexer?
Lowercase variation of Meta-WebIndexer.
Test if meta-webindexer can access your URL
Enter URL to test if meta-webindexer is allowed or blocked.
Is meta-webindexer safe?
Yes, meta-webindexer is considered safe.
This bot is verified and generally respected by the SEO community.
For more information about our safety badges, visit our documentation.
User-Agent String used by meta-webindexer
meta-webindexerHow to block meta-webindexer with robots.txt?
Add the following standard robots.txt rule to prevent meta-webindexer from accessing your site.
User-agent: meta-webindexer Disallow: /
What happens if I block meta-webindexer?
Medium Impact
Blocking meta-webindexer may prevent proper link previews when your content is shared on social media platforms. This could affect how your links appear when shared, but won't impact search rankings.
Common use cases for meta-webindexer
Understanding how meta-webindexer is typically used can help you make informed decisions about whether to allow or block it on your website.
- Generates link previews for social media shares
- Fetches Open Graph and Twitter Card metadata
- Creates rich snippets when links are posted
- Validates and displays website thumbnails
- Improves user experience on social platforms