A/O/Google/Microsoft jointly drafted a statement to reject AI training. Websites only need to add a statement to block Google, Microsoft, OpenAI and Anthropic are supporting the new AI training preference statement, which allows websites to modify robots

A/O/Google/Microsoft jointly drafted a statement to reject AI training. Websites only need to add a statement to block Google, Microsoft, OpenAI and Anthropic. They are supporting the new AI training preference statement, which allows websites to indicate whether content is allowed to be used by AI companies to train models by modifying robots.txt. Under the draft, website administrators would only need to add a set of rules to make a statement to multiple AI companies supporting the rules. The declaration content is as follows: 1. # Site-wide ban rule 2. User-Agent: __usage_ai-training 3. Disallow:/ 4. # Example of allowing specific directories 5. User-Agent: __usage_ai-training 6. Allow:/archive/ 7. # Example of not allowing specific directories 8. User-Agent: __usage_ai-training 9. disallow:/archive/ 10. # Allowing specific directories does not conflict with the site-wide ban, that is, /archive/ is allowed but all other directories are prohibited. Adding this content to the website robots.txt file will declare that the entire site content is prohibited from being used for training AI models. The website administrator can also modify the allowed or disallowed directories. For example, some directories are allowed to be used for AI training, and some contents are not allowed to be used for AI training. Each support time is different: The plan is still an Internet draft, but Microsoft has said that the company will follow the statement from February 1, 2027, so websites that do not want their content to be used for AI training can modify the file now to add the relevant statement. The plan for Google is to provide support from the beginning of 2027, but the specific time has yet to be completed before subsequent preparations are completed. OpenAI said it would implement the plan in the coming months, and Anthropic appears to have started supporting the draft. Prohibiting training and quoting content to generate answers belong to different purposes: The above statement only expresses the website's choice of content use. According to the draft instructions, setting the above statement alone will not directly prevent crawlers from accessing the web page. If the website wants to restrict specific crawlers from crawling content, it still needs to be configured through traditional robots.txt rules. Training content and AI answer reference web pages also belong to different purposes. Microsoft provides additional AI Grounding controls for its own services for websites to decide whether the content allows AI to generate answers.