Site
Overview
The numbers that decide where to start, and how every URL answered.
What it is for
The Overview is where a crawl opens. It does not list pages itself: it gives the handful of numbers that decide where to start, and one row per view with what that view answers and how many items wait in it. Every tile and every row opens the view behind it.
The headline numbers

- Pages crawled
- Pages that were fetched and answered with an HTML page (status 2xx). Only these are pages of the link graph.
- In-content links
- Links placed in page content, outside navigation and other repeated blocks. See How links are counted.
- Link issues
- Errors and warnings found by the checks in Issues. Checks of the kind “info” are not counted here.
- Under-linked pages
- Pages with no inbound links, only navigation links, or fewer content links than the site's average. See Under-linked.
- Deep pages
- Pages more than three clicks from the start page. See Depth.
- Link suggestions
- Places to add an internal link. See Suggestions.
Crawl health
How every fetched URL answered:
- Indexable pages: the OK pages with no noindex and no canonical tag pointing to another page. These are the pages that can appear in search results.
- Response time: the median time your server took to answer, measured until the response headers arrived (redirects included), and the time within which 90% of pages answered. Click it to list the slowest pages.
- Status codes: one bar per answer, such as 200, 301 or 404, plus files that are not HTML and URLs that did not answer at all. Click a bar to list those URLs in Pages.
Warnings
When the crawl could not do everything, a yellow box above the numbers says so, so you read them with that in mind. The most common:
- No links in the HTML
- More than half of the pages have no links in the HTML the server sends. The site probably builds its navigation with JavaScript, which the crawler does not run, so those links are missing from every figure.
- No sitemap found
- Pages were found by following links only. Pages nothing links to cannot be found this way.
- robots.txt
- robots.txt could not be read, or it disallows LinkTasteBot at the start address, so only allowed sitemap pages were crawled.
- Time limit
- The crawl reached its time limit of 72 hours; the pages fetched until then are analysed.
- A stage failed
- One step after fetching (the ranking, the topics or the suggestions) did not finish. The pages and links are complete; the message says what is missing.
- Language
- Suggestions from the text need a supported language (German, English, French, Spanish, Italian, Dutch). For other languages no links are suggested.