Cloudflare launched "Disallow AI Training." The new feature gives website operators control over how AI models use their content. It allows sites to remain discoverable in search engine results. The tool also prevents their content from AI training.
The feature addresses a dilemma for content creators. They previously chose between search index inclusion and allowing data scraping for AI training. Many large tech companies use the same crawlers for both functions. Major tech companies, including Apple, Google, and Microsoft, will honor the new setting.