Say It Once: Introducing Bot Preference Sync
Cloudflare, Friday, August 21st, 2026
Cloudflare's Bot Preference Sync automatically aligns robots.txt with configured AI bot policies for search, agents and training.
Cloudflare introduced Bot Preference Sync, which automatically aligns a site's robots.txt file with its configured AI bot policies for search, agent and training use. Customers no longer need to maintain static files separately from their enforcement rules.
Cloudflare notes that its customers pursue different goals: some optimize for discovery while others want the strictest possible content protection. Multiple mechanisms exist to mitigate bot traffic, and some merely state a preference while others enforce it.
Bot Preference Sync keeps the stated preference and the enforced policy consistent without manual upkeep.