Make your site work for AI agents

Three guides, built on the same eight checks the Index scores 113 sites on every week — and on what we watch a real agent run into every week on the Field Test. Nothing invented, nothing you can't test with curl.

AI Readiness Audit Checklist for WebsitesThe eight checks a real AI agent needs your site to pass — llms.txt, crawler policy, readable HTML, structured data, sitemap, reachable pricing and support, MCP and OpenAPI — with a 60-second self-test for each.llms.txt and OpenAPI for AI AgentsHow to write an llms.txt that AI agents can actually use, publish OpenAPI and MCP so they can act, and serve the file correctly from FastAPI, Django, Express, Hono, Next.js, Laravel, Rails, Go, ASP.NET and more.Technical SEO for AI DiscoverySearch engines and AI agents want mostly the same things from your site — but agents fail in different places. Server rendering, bot walls, structured data, one-hop navigation, and how to measure it with real agent transcripts.