Bots receive errors

Error severity, in the logs tab

Why it matters

Search engine or AI crawlers requested this URL and got a 4xx or 5xx, in the logs or in this crawl. Repeated errors drop the URL from the index and waste crawl budget.

How to fix it

Fix the error or redirect (301) the URL to a live page; for retired URLs return 410 and remove internal links and sitemap entries.

How Crawlune finds it

Crawlune flags Bots receive errors automatically on every crawl and lists the affected URLs under the logs tab, where you can filter, inspect each page and export the list to CSV. The free version crawls up to 550 URLs with every check enabled.