Factset_spyderbot User-Agent & Blocking Rules
Operated by FactSet. Verify the official user-agent string and safety status for this bot. Use the tools below to run a live crawlability test and get copy-paste robots.txt rules to manage its access. Crawler info last updated on .
What is Factset_spyderbot?
The web crawler for FactSet, a financial data and software company, used to gather market intelligence.
Test if Factset_spyderbot can access your URL
Enter URL to test if Factset_spyderbot is allowed or blocked.
Is Factset_spyderbot safe?
It is recommended to use caution with Factset_spyderbot.
Caution bots may have legitimate uses but can be resource-intensive or used for competitive intelligence.
For more information about our safety badges, visit our documentation.
User-Agent String used by Factset_spyderbot
Factset_spyderbotHow to block Factset_spyderbot with robots.txt?
Add the following standard robots.txt rule to prevent Factset_spyderbot from accessing your site.
User-agent: Factset_spyderbot Disallow: /
What happens if I block Factset_spyderbot?
Low Impact
Blocking Factset_spyderbot will prevent automated scraping of your content. This is generally safe and recommended to protect your content and reduce server load. Your search rankings will NOT be affected.
Common use cases for Factset_spyderbot
Understanding how Factset_spyderbot is typically used can help you make informed decisions about whether to allow or block it on your website.
- Extracts content, prices, or data from websites
- May be used for competitive intelligence
- Often operates without explicit permission
- Can increase server load and bandwidth usage
- May violate terms of service or copyright