🔒Cloudflare Launches Disallow AI Training Setting
Website owners can now block AI training without losing search
TL;DR
Cloudflare introduces a Disallow AI Training setting, allowing website owners to block AI training while maintaining search discoverability. Apple, Google, and Microsoft commit to honoring this setting, with more granular controls coming by early next year.
Cloudflare has launched a Disallow AI Training setting, giving website owners the ability to block AI training crawlers while keeping their content indexed for search. This is a significant move for developers and site owners who want to protect their content from misuse while still benefiting from search engine traffic. By early next year, Cloudflare plans to introduce more granular controls, allowing site owners to specify how much of their content appears in AI summaries. This setting is crucial for those who want to maintain a balance between AI training and search visibility, as it addresses the growing concern of mixed-use crawlers that both index and train on content.
Key Points
Cloudflare's Disallow AI Training setting is available now, with Apple, Google, and Microsoft committed to honoring it.
By early next year, Cloudflare aims to introduce more granular controls for AI summaries.
17% of site owners choose to enable some mechanism to block AI training, highlighting the growing concern.
Cloudflare classifies bots into three behaviors: Search, Training, and Agent, with Disallow AI Training only for Training.
On September 15, Cloudflare will apply Block and Block on pages with ads to mixed-use crawlers and make Disallow AI Training part of the recommended configuration for new domains.
Why It Matters
If you're a site owner worried about AI training but still want to be discoverable in search, Cloudflare's Disallow AI Training setting is a game-changer. It allows you to block AI training while maintaining traditional search results. For example, if you're running a blog on WordPress and want to protect your content from being used in AI training, this setting gives you the control you need. However, it's important to note that the effectiveness of this setting depends on the commitment of major tech companies like Apple, Google, and Microsoft.
Comments
Be the first to comment
Enjoyed this article?
Get it daily. 7am. Free. Reads in 5 minutes.