Votre navigateur est obsolète. Le site pourrait ne pas s'afficher correctement. Veuillez mettre votre navigateur à jour.

Connaissances
Connaissances
Les boîtes à outils SEMrush
Boîte à outils SEO
Audit de site
Why do working pages on my website appear as broken?

Why do working pages on my website appear as broken?

Question

There may be a time where Site Audit may show that some of your internal pages are reported as broken but are actually still fully up-and-running. While this does not happen often, it can be confusing for some users.

Generally, when this happens it's because of a false-positive. The three most common reasons for a false-positive reading are:

  • Our Site Audit crawler could have been blocked for some pages in robots.txt or by noindex tagsWhy do working pages on my website appear as broken? image 1
  • Hosting providers might block SEMrush bots as they believe it is a DDoS attack (massive amount of hits during a short period of time)
  • At the moment of the campaign re-crawl, the domain could not be resolved by DNS

If you believe it’s happening because of a crawler issue you can learn how to troubleshoot your robots.txt with this full article

You can also lower the crawl speed in order to avoid a large number of hits on your pages at one time. That is why you could see this page as a working one, which is right, and our bot was unable to do so and reported the false-positive result.

Why do working pages on my website appear as broken? image 2