Google adds a shared AI training control to robots.txt

In a Search Central post dated October 30, 2026, Google said it plans to support a shared AI training control in robots.txt. A site owner would be able to state one training preference that reaches several AI providers. Google aims to support it in 2027.

What is changing?

According to Google's announcement, the proposal builds on work by the IETF's AIPREF working group. Under the current setup each AI developer needs its own instruction; for Google that instruction has been Google-Extended since 2023. With the new approach a shared "policy token" would sit in robots.txt and pass a broad preference to every participating provider.

How will Google read it?

If a site opts out of training with the token and does not specify Google-Extended, Google plans to treat that as if Google-Extended had been disallowed. Company-specific controls keep working next to the new signal, so you can set a general preference with the token and a separate one for Google with Google-Extended. The post also says sites that explicitly allow Google-Extended are eligible to appear in responses and receive clicks through grounding in Gemini Apps.

What should site owners do now?

Nothing needs to change: Google describes this as a draft proposal and gives 2027 as the target for support. It is still a good moment to open your robots.txt and check what you currently tell each AI bot. This preference concerns training use; how your content is structured to appear in search and AI summaries is a separate matter, which we cover in our SEO, GEO and AEO service.