Check your site · checklist

Readiness checklist for your site

These are the same five checks we would run by hand. This page doesn't scan your site automatically — work through each one yourself.

Is there an llms.txt at the root? Open https://yourdomain.com/llms.txt. If you get a 404, you don't have one yet.
Does robots.txt allow the AI crawlers you want? Look for rules naming GPTBot, ClaudeBot, PerplexityBot or Google-Extended. A blanket Disallow: / blocks them all.
Is your sitemap referenced? A Sitemap: line in robots.txt is the easiest way for any crawler to find your pages.
Do your key pages work without JavaScript? Many AI crawlers don't run scripts. If your main content only appears after JavaScript loads, they may see an empty page.
Do your most important pages say what they are in the first paragraph? AI answers lean heavily on the opening of a page.

Want help with number one?

Tell us a little about the site and we'll put together an llms.txt plan for it.