Content Signals
In short
Content Signals states your terms for AI use of your content in a place machines read. Which AI bots and agents to let in is the next stop after Content Signals. robots.txt and Training crawler sit beside it in the glossary. Cloudflare's Radar scan found 4 percent of top sites declared AI preferences with Content Signals (17 Apr 2026).
Definition
A line in robots.txt that states how your content may be used, for example for search, AI input or training.
A dated example
- Read 4 Nov 2026
Cloudflare's Radar scan found 4 percent of top sites declared AI preferences with Content Signals (17 Apr 2026).
Where it matters
It states your terms for AI use of your content in a place machines read.
Related terms
- robots.txtA public text file at the root of a site that tells automated visitors which parts they may visit.
- Training crawlerA crawler that takes pages to train or fine-tune an AI model.
Sources
- Cloudflare: Introducing the Agent Readiness score (17 Apr 2026) (blog.cloudflare.com/agent-readiness), read 4 Nov 2026.
Last reviewed