DevelopingPolicy

OpenAI and Google plan to honor a shared robots.txt token for AI training opt-outs

An IETF Internet-Draft by Anthropic's Kevin Kelley, dated Oct. 30, defines a robots.txt token, __usage_ai-training, for stating AI training preferences. OpenAI says it aims to honor it in the coming months. Google plans support in early 2027 and will treat an opt-out as Google-Extended disallowed. The draft is individual and not IETF-endorsed.

HEAT
OUTLETS: 9
NEW IN 6H: +2
FIRST SEEN: Oct 30, 2026, 16:26 ET
LAST SIGNAL: 2h ago

Made the five · #3 on Saturday, October 31, 2026

OpenAI, Google, Microsoft back one AI training opt-out

Primary source

IETF Datatrackerdatatracker.ietf.org/doc/draft-kelley-aipref-training-preference-signal/

Coverage · 10 articles, oldest first

Friday, October 30, 2026

16:26
The Verge
The biggest names in AI are backing a new way to opt out of scraping
17:10
Unite.AI
unite.ai/openai-to-honor-shared-robots-txt-signal-for-ai-training-preferences/
17:10
Search Engine Roundtable
seroundtable.com/google-ai-training-control-42430.html
17:40
IETF Datatracker
datatracker.ietf.org/doc/draft-kelley-aipref-training-preference-signal/
18:10
Bing Blogs
blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/
18:40
Thurrott
thurrott.com/a-i/343407/anthropic-google-microsoft-and-openai-agree-to-let-sites-opt-out-of-ai-training
22:00
SiliconANGLE
Google, Anthropic and others to support new AI crawling opt-out standard

Saturday, October 31, 2026

02:40
PPC Land
ppc.land/google-and-bing-back-one-robots-txt-rule-to-opt-out-of-ai-training/
04:10
Malay Mail
malaymail.com/news/money/2026/10/31/after-scraping-the-internet-ai-giants-pledge-no-scraping-tool-for-publishers/241430
04:40
PPC Land
ppc.land/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out/

ShareX LinkedIn Hacker News Email

← The whole wire