60/100 C #86 of 113
Audited August 27, 2026 from public surfaces only. Can AI agents discover, read, and act on llamaindex.ai? Check by check:
GPTBot: allowed ClaudeBot: allowed Claude-User: allowed PerplexityBot: allowed Google-Extended: allowed CCBot: allowed
| Check | Finding | Points | Result |
|---|---|---|---|
| A1 | llms.txt for AI readers No /llms.txt found — AI readers get no curated entry point. |
0/15 | fail |
| A2 | AI crawler access policy robots.txt allows the major AI crawlers and agents. |
15/15 | pass |
| A3 | Content readable without a browser Plain fetch of the homepage yields ~1178 words of visible text. |
25/25 | pass |
| A4 | Structured data (schema.org JSON-LD) No machine-readable entity markup on the homepage. |
0/15 | fail |
| A5 | Sitemap discoverable No sitemap found. |
0/10 | fail |
| A6 | Everyday agent tasks reachable from the homepage Found from homepage: pricing, support/contact, docs/api, legal/privacy. |
20/20 | pass |
| B1 | MCP server advertised No MCP advertisement (bonus check — most sites skip this). |
0/5 | skip |
| B2 | OpenAPI description published No OpenAPI document (bonus check — only relevant for APIs). |
0/5 | skip |