OAI-SearchBot
OAI-SearchBot is OpenAI's crawler for ChatGPT search. Sites that block it in robots.txt will not appear in ChatGPT search answers as cited sources.
Updated · Citable
What OAI-SearchBot means
OpenAI runs several user agents. OAI-SearchBot finds and indexes pages so ChatGPT's search feature can surface and link to them. It is separate from GPTBot, which collects training data: you can allow one and block the other.
User-agent: OAI-SearchBot
Allow: /
User-agent: GPTBot
Disallow: /OpenAI says robots.txt changes for search take about 24 hours to apply.