Scorecard for publishers and media
In short
In the crawl of 4 Nov 2026, 61.3 percent of publishing sites with a readable robots.txt allowed the four main AI agents, and 86.2 percent of home pages showed readable text to a plain fetch. The sample is 227 domains, a complete first edition. The largest share, 74 of 227 rows, comes from Ora's Gaming & Media category.
The four numbers
- 61%allow the four main AI agents119 of 194 sites with a readable robots.txt let GPTBot, ClaudeBot, PerplexityBot and Google-Extended in at the root
- 86%show readable text on the home page144 of 167 home pages gave a plain fetch 150 words or more of text, not a script-only shell
- 1%publish any act surface2 of 207 sites answered with an MCP manifest, an OpenAPI file, an agent card or agents.json at a standard path
- 0.5%publish a payment or commerce file1 of 209 sites answered with a UCP profile at /.well-known/ucp.json
Against the whole crawl
| Measure | This sector | All crawled domains |
|---|---|---|
| Allow main agents | 61.3% (119 of 194) | 84.4% (7,282 of 8,624) |
| Readable home page | 86.2% (144 of 167) | 84.9% (7,457 of 8,783) |
| Any act surface | 1% (2 of 207) | 2.1% (216 of 10,385) |
| Any payment surface | 0.5% (1 of 209) | 0.6% (62 of 10,439) |
The share allowing the main agents is 23.1 points below the crawl as a whole, and the share with readable home page text is 1.3 points above it.
How this sector was sampled
227 domains fall in this sector. The sector figures use Ora leaderboard categories as stand-ins, not a definition of the sector: Gaming & Media (74 rows), News & Intelligence (36 rows), plus 117 domains placed by a keyword on the domain name. 221 answered a plain fetch. The percentages use the denominators shown in each row, because a site with no readable robots.txt, or a home page that did not return 200, cannot be counted in that measure.
The methodology lists the category and keyword rules. Sector assignment by keyword is rough by design, and a site can sit in the wrong sector; the leaderboard category is the stronger signal. For context, Ora's own leaderboard averaged 48.6 out of 100 over 36 News & Intelligence entries on 5 Nov 2026 (vendor-published).
What to do with it
- Ask your web team for the same four checks on your own site: robots.txt rules for the four agents, home page text without scripts, any act file, any payment file.
- Take the publishing guide to the meeting where those decisions are made.
- Run the self-check for publishing to see which of your own answers are open.
Sources
- Scorecard methodology: the crawl of 4 Nov 2026 (amireadyforagents.com/scorecards/methodology), read 4 Nov 2026.
- Sector scorecards dataset, edition 4 Nov 2026 (amireadyforagents.com/scorecards), read 4 Nov 2026.
Last reviewed