Skip to content
Crawlune

Googlebot spends crawl budget on a non-indexable page

Warning severity, in the logs tab

Why it matters

Googlebot fetched this noindex or canonicalised page repeatedly. Every fetch of a page that cannot rank is budget not spent on pages that can.

How to fix it

Reduce internal links and sitemap entries pointing here, block crawl-only URL patterns in robots.txt, or make the page indexable if it should rank.

How Crawlune finds it

Crawlune flags Googlebot spends crawl budget on a non-indexable page automatically on every crawl and lists the affected URLs under the logs tab, where you can filter, inspect each page and export the list to CSV. The free version crawls up to 550 URLs with every check enabled.

Download Crawlune

Related logs checks