Agent readiness scorecards by sector

In short

A crawl of 13,071 top websites on 4 November 2026 sliced into eight sectors: how many allow the four main AI agents, show readable text to a plain fetch, publish any act surface or any payment file. This is the complete first edition. The data downloads as CSV and JSON.

Share of sites that allow the four main AI agents

Each dot is a sector. The measure is the share of sites with a readable robots.txt whose rules let GPTBot, ClaudeBot, PerplexityBot and Google-Extended in at the site root. The whole crawl sits at 84.4 percent.

Share of sites allowing the four main AI agents at the root, by sector0%25%50%75%100%Ecommerce and retail94.5%Bookings, travel and hospitality72.7%Publishers and media61.3%SaaS and B2B software95.3%Professional and B2B services96.8%Healthcare and clinics92.7%Financial services95.8%Local and multi-location businesses94.5%
Share of sites allowing the four main AI agents at the root, by sector. Ecommerce and retail: 94.5 percent, 190 of 201 sites. Bookings, travel and hospitality: 72.7 percent, 16 of 22 sites. Publishers and media: 61.3 percent, 119 of 194 sites. SaaS and B2B software: 95.3 percent, 936 of 982 sites. Professional and B2B services: 96.8 percent, 331 of 342 sites. Healthcare and clinics: 92.7 percent, 217 of 234 sites. Financial services: 95.8 percent, 366 of 382 sites. Local and multi-location businesses: 94.5 percent, 138 of 146 sites.

All four measures, side by side

Sector scorecards, crawl of 4 Nov 2026
SectorDomainsAllow agentsReadable home pageAny act surfaceAny payment file
Ecommerce and retail25694.5%83.4%3.5%5.6%
Bookings, travel and hospitality3272.7%75%0%0%
Publishers and media22761.3%86.2%1%0.5%
SaaS and B2B software1,24695.3%90.4%7.2%0.3%
Professional and B2B services37796.8%95.5%3.6%0%
Healthcare and clinics27992.7%88.8%4.1%3.3%
Financial services44895.8%92.1%2.3%0%
Local and multi-location businesses18094.5%90.1%1.2%6.4%
All crawled domains13,07184.4%84.9%2.1%0.6%

Sectors are assigned from the Ora leaderboard category where a domain has one, and by a small keyword list on the domain otherwise. 10,026 crawled domains fit no sector and count only in the last row. The methodology explains each count.

Download the data

Cite this: Am I Ready for Agents?, "Agent readiness by sector, first edition", edition 4 November 2026, https://amireadyforagents.com/scorecards

The data is free to use with the citation above. It describes what a plain fetch with an honest user agent found on the crawl date; sites change, so the next edition will move these numbers.

The eight sector scorecards

Sources

  1. Scorecard methodology: the crawl of 4 Nov 2026 (amireadyforagents.com/scorecards/methodology), read 4 Nov 2026.

Last reviewed