agentability

Agentability · Methodology

How scoring works

Eight checks, all against public surfaces, all reproducible with plain HTTP requests. No invented standards: every check is traceable to a convention that real AI systems use in 2026.

CheckWhat & whyPoints
A1llms.txt — the llmstxt.org convention: a curated, plain-text entry point for AI readers. Substantive file with links required.15
A2AI-crawler policy — robots.txt rules for GPTBot, ClaudeBot, Claude-User, PerplexityBot, Google-Extended, CCBot. Open access scores full points; blanket blocks score zero and are labeled “closed by policy” (a stance, not a bug — but it is what it is).15
A3Content readable without a browser — a plain fetch of the homepage must yield real text, not a JavaScript wall or a bot challenge. Agents don't run your SPA.25
A4Structured data — valid schema.org JSON-LD so machines learn what the entity is.15
A5Sitemap — advertised in robots.txt or served at /sitemap.xml.10
A6Everyday agent tasks — pricing, support, docs, and legal reachable from the homepage; the links an assistant needs for the questions people actually ask.20
B1MCP server advertised at /.well-known/mcp.json — bonus; the emerging standard for callable sites.+5
B2OpenAPI document published — bonus; only relevant where an API exists.+5

Grades

A ≥ 85 · B ≥ 70 · C ≥ 55 · D ≥ 40 · F < 40. Sites whose robots.txt blocks essentially all AI crawlers are labeled “Closed by policy” instead of graded — refusing agents is a legitimate choice, and we report it as one rather than pretending it's a defect.

The Agent Field Test

The weekly Field Test is the empirical companion to the Index: instead of checking plumbing, it watches a real agent try real errands. The rules:

Autonomous end to endAn AI producer invents each episode's tasks (grounded in the audited panel, avoiding past topics); a separate agent attempts them. No human writes, selects, or edits an episode.
Read-only, by constructionThe agent's only tool is a plain HTTP GET. It cannot run JavaScript, log in, submit forms, create accounts, or buy anything.
Hard limitsAt most 14 page visits per task, a fixed token budget per episode, and the model is named on every page. (We pay for the API calls for fun.)
Verbatim or nothingTranscripts are published exactly as they happened — no retries, no cherry-picking, failures included. The raw JSON is open data.
Honest reportingThe agent is instructed never to invent facts it didn't read on a page, and to report failure plainly. "Gave up honestly" is a first-class outcome.

Reproducibility

The evaluator is ~300 lines of dependency-free TypeScript in the open repo, runs weekly in public GitHub Actions, and commits raw results to the repository. The field-test agent and producer are in the same repo. Disagree with a check or a transcript? Open an issue — everything is versioned in public.