Agent readiness KPIs for a leadership team
In short
Track four numbers each quarter: your Ora score and grade, the gap to your sector's median, whether an agent finishes your main task, and your self-check level. Each has a source, an owner and a cadence below. Keep mentions in AI answers as a separate line, because it measures something else.
The four numbers
| Number | What it tells the board | Where it comes from | How often | Owner |
|---|---|---|---|---|
| Ora score and grade | How readable and usable your public site is to agents | A scan at Ora, free; the score out of 100, the grade and four layer scores | After each fix and once a quarter | Web lead |
| Gap to the sector median | Where you stand against the sites Ora lists in your sector | The sector's median on the sector guide, from Ora's leaderboard | Once a quarter | Head of digital |
| Main task finished by an agent | Whether an agent can complete the job a customer wants done | Ora's Journey test, or your own walk-through as a guest from the one-hour audit | Once a quarter, on the same task | Ecommerce or product lead |
| Self-check level | Whether the decisions that belong to leadership are made | The self-check, scored in your browser | Once a quarter | The leader who owns agent experience |
Mentions in AI answers are a fifth line, kept apart. Visibility platforms track them by re-running prompts, and they answer a different question from whether an agent can finish a task. The visibility platforms are listed with their prices and what to ask a vendor covers the questions.
Compare like with like
Ora's leaderboard entries were last scanned on 123 different days between 7 Apr 2026 and 5 Nov 2026. 1,974 of the 3,453 were scanned in the 30 days before 5 Nov 2026, and 567 more than 90 days before. A sector median is a good yardstick; a comparison with one named competitor is only fair if both were scanned the same week, so rescan yours before you quote the gap.
- Do not blend the four numbers into one score. They move for different reasons.
- Do not quote a one or two point move. Ora says the same scan agrees with itself within a couple of points.
- Do not put scores from several scanners side by side. They measure different things; the tool choice page says which one to use.
How the line reads in a quarterly report
A fill-in version for the report, with the sector median from your guide and the dates of the scans:
Ora score [score] out of 100, grade [grade], scanned [date]. Sector median [median] (Ora's leaderboard, 5 Nov 2026), so we are [above or below] it by [points]. The weakest layer is [layer] at [percent]. An agent [finished or did not finish] the main task on [date], stopping at [step]. Self-check level [level], held back by [area].
The full one-page layout, with the open decisions and their owners, is in how to report agent readiness to your board.
Sources
- Ora leaderboard API (GET /api/leaderboard) (ora.ai/api/leaderboard), read 5 Nov 2026. Vendor claim.
- Ora: Introducing Deep Scan (8 Apr 2026) (ora.ai/blog/introducing-deep-scan), read 5 Nov 2026. Vendor claim.
- Ora llms.txt (ora.ai/llms.txt), read 5 Nov 2026. Vendor claim.
Last reviewed