Skip to content
Crawlune

llms.txt is incomplete

Opportunity severity, in the AI search tab

Why it matters

The llms.txt file exists but misses parts of the convention (a title line, a short summary and markdown links to key pages), so AI systems get little from it.

How to fix it

Start the file with an H1 title, follow it with a blockquote summary, and list the most important pages as markdown links grouped under H2 headings.

How Crawlune finds it

Crawlune flags llms.txt is incomplete automatically on every crawl and lists the affected URLs under the AI search tab, where you can filter, inspect each page and export the list to CSV. The free version crawls up to 550 URLs with every check enabled.

Download Crawlune

Related ai search checks