llms.txt is incomplete
Opportunity severity, in the AI search tab
Why it matters
The llms.txt file exists but misses parts of the convention (a title line, a short summary and markdown links to key pages), so AI systems get little from it.
How to fix it
Start the file with an H1 title, follow it with a blockquote summary, and list the most important pages as markdown links grouped under H2 headings.
How Crawlune finds it
Crawlune flags llms.txt is incomplete automatically on every crawl and lists the affected URLs under the AI search tab, where you can filter, inspect each page and export the list to CSV. The free version crawls up to 550 URLs with every check enabled.
Download Crawlune