ia_archiver-web.archive.org User-Agent & Blocking Rules
Operated by Internet Archive
Other Agents Safe
What is ia_archiver-web.archive.org?
Specific variation of the Internet Archive crawler.
Test if ia_archiver-web.archive.org can access your URL
Enter URL to test if ia_archiver-web.archive.org is allowed or blocked.
Is ia_archiver-web.archive.org Safe?
Yes, ia_archiver-web.archive.org is considered safe.
This bot is verified and generally respected by the SEO community.
For more information about our safety badges, visit our documentation.
User-Agent String used by ia_archiver-web.archive.org
ia_archiver-web.archive.orgHow to Block ia_archiver-web.archive.org?
Add the following standard robots.txt rule to prevent ia_archiver-web.archive.org from accessing your site.
User-agent: ia_archiver-web.archive.org Disallow: /