AspiegelBot User-Agent & Blocking Rules
Operated by Huawei (Aspiegel). Verify the official user-agent string and safety status for this bot. Use the tools below to run a live crawlability test and get copy-paste robots.txt rules to manage its access. Crawler info last updated on .
What is AspiegelBot?
AspiegelBot is a web crawler associated with Huawei's Petal Search ecosystem, operating primarily from Ireland.
Test if AspiegelBot can access your URL
Enter URL to test if AspiegelBot is allowed or blocked.
Is AspiegelBot safe?
Yes, AspiegelBot is considered safe.
This bot is verified and generally respected by the SEO community.
For more information about our safety badges, visit our documentation.
User-Agent String used by AspiegelBot
AspiegelBotHow to block AspiegelBot with robots.txt?
Add the following standard robots.txt rule to prevent AspiegelBot from accessing your site.
User-agent: AspiegelBot Disallow: /
What happens if I block AspiegelBot?
Critical Impact
Blocking AspiegelBot will prevent your website from appearing in search results. This will significantly reduce your organic traffic and visibility. Only block if you intentionally want to remove your site from this search engine.
Common use cases for AspiegelBot
Understanding how AspiegelBot is typically used can help you make informed decisions about whether to allow or block it on your website.
- Crawls and indexes web pages for search results
- Discovers new and updated content on your website
- Analyzes page structure, content, and links for ranking
- Renders JavaScript to understand dynamic content
- Checks for mobile-friendliness and page speed