--- title: "Cloudflare syncs bot choices | Am I Ready for Agents?" description: "Cloudflare syncs AI bot choices into robots.txt, 21 Aug 2026. The source and the date it was read are given. Why it matters to a leader and what to check." canonical: https://amireadyforagents.com/news/2026-08-21-cloudflare-syncs-ai-bot-choices-into-robots-txt site: "Am I Ready for Agents?" last_updated: 2026-11-04 date: 2026-08-21 section: "News" --- # Cloudflare syncs bot choices | Am I Ready for Agents? > Cloudflare syncs AI bot choices into robots.txt, 21 Aug 2026. The source and the date it was read are given. Why it matters to a leader and what to check. Source: https://amireadyforagents.com/news/2026-08-21-cloudflare-syncs-ai-bot-choices-into-robots-txt Site: Am I Ready for Agents? Last reviewed: 2026-11-04 # Cloudflare syncs AI bot choices into robots.txt ## In short Cloudflare syncs AI bot choices into robots.txt, on 21 Aug 2026. The preference you state in robots.txt and the rule your CDN enforces can now be kept in step from one setting. Check whether your CDN offers the same and whether the two currently agree. ## What happened 21 August 2026. Cloudflare launched Bot Preference Sync, which writes the choices a site sets for Search, Agent and Training traffic into its robots.txt so the stated preference and the enforced rule match. It is available from the Free plan up. - 21 Aug 2026 Cloudflare launched Bot Preference Sync, which writes the choices a site sets for Search, Agent and Training traffic into its robots.txt so the stated preference and the enforced rule match. It is available from the Free plan up. [Cloudflare: Bot Preference Sync (21 Aug 2026)](https://blog.cloudflare.com/bot-preference-sync/), read 4 Nov 2026 ## Why it matters to a leader The preference you state in robots.txt and the rule your CDN enforces can now be kept in step from one setting. ## What to check Check whether your CDN offers the same and whether the two currently agree. - [What Cloudflare's AI defaults mean](https://amireadyforagents.com/guides/what-cloudflare-ai-defaults-mean-for-you) - [Which AI bots to let in](https://amireadyforagents.com/decisions/which-bots-to-allow) ## Sources 1. [Cloudflare: Bot Preference Sync (21 Aug 2026)](https://blog.cloudflare.com/bot-preference-sync/) (blog.cloudflare.com/bot-preference-sync), read 4 Nov 2026. Last reviewed 4 November 2026 Reviewed 4 November 2026. [1 source](#sources), each with the day it was read.