URL Response Reports

This group of reports allows you to see a server response on each requested URL. While crawling, Site Visualizer checks every link that was found on the website: regular <A> links, references to images and other files, as well as links to other domains (external links). To execute a response report, double-click it:

404 URLs

The first report is an overview of all responses. It contains the number of each response code. The Success (2xx), Redirection (3xx), Client Error (4xx), and Server Error (5xx) reports contain detailed information on every link that has a response:

URL responses report

Blocked by robots.txt shows URLs disallowed by the website's robots.txt file. To URL column contains blocked URL address, Response column contains the line number and the matched disallow rule of the robots.txt file:

URLs blocked by robots