Allen Institute for AI Bots & Crawlers

Our crawler directory currently tracks 2 web crawlers operated by Allen Institute for AI. Analyze the safety statuses, bot categories, and user-agent strings for every bot in this operator's fleet. Operator info last updated on .

About Allen Institute for AI

The Allen Institute for AI (AI2) operates AI2Bot for open-source AI research and dataset creation. Ai2Bot-Dolma is a specific crawler used to build the Dolma dataset, a massive open corpus for training language models. These crawlers support academic and open-source AI research initiatives.

Visit Website

Operator data update history

First added on

Last updated on

2 Bots from Allen Institute for AI

Bot NameUser-AgentCategorySafety
AI2BotAI2BotAI BotsCaution
Ai2Bot-DolmaAi2Bot-DolmaAI BotsCaution
Browse all Operators → Return to Directory → Return to CrawlerCheck →