Skip to Content

Pages buried too deep in the site

What Is This Issue

Crawl depth refers to how many clicks it takes to reach a page starting from the homepage. This issue checks whether important internal pages are discoverable within a shallow click depth (3 clicks or fewer) from the homepage. Pages buried too deep in the site structure may be harder for search engines to discover and crawl.

A passing implementation requires:

  • Important pages are reachable within 3 clicks from the homepage
  • Internal linking structure provides clear paths to key content
  • No important pages are “orphaned” (not linked from any other page)
  • Navigation menus and internal links are crawlable (not generated only by JavaScript)

Example: A product page that can be reached by clicking: Homepage → Products → Category → Product (3 clicks) is at an acceptable depth.

Why Is This Important

Crawl depth is important for SEO because it:

  • Affects Crawlability: Search engines prioritize crawling pages that are closer to the homepage
  • Impacts Indexation: Pages buried too deep may be crawled less frequently or not at all
  • Affects Rankings: Shallow pages typically receive more crawl attention and link equity
  • Optimizes Crawl Budget: Search engines have limited crawl budget; shallow structures make the most of it

Pages that require more than 3 clicks from the homepage may experience delayed indexing, reduced crawl frequency, and weaker ranking signals. This directly impacts your SEO health score by making it harder for search engines to discover and value your content.

How XeoPix Detects This

XeoPix performs crawl depth analysis through the following logical steps:

  1. Homepage Crawling: XeoPix starts by crawling your homepage and extracting all internal links from the HTML.

  2. Link Graph Construction: XeoPix builds a map of your site’s internal linking structure, treating each page as a node and each link as a connection.

  3. Breadth-First Search (BFS): XeoPix performs a BFS starting from the homepage to calculate the minimum number of clicks required to reach each page.

  4. Depth Calculation: XeoPix records the click depth for each page and flags pages that:

    • Require more than 3 clicks from the homepage (WARNING)
    • Cannot be reached from the homepage through internal links (WARNING)
  5. Coverage Check: XeoPix also checks if pages discovered through sitemaps or seeds are reachable through the internal link graph.

Note: XeoPix analyzes links in raw HTML only and does not execute JavaScript. Navigation generated only by JavaScript cannot be detected for crawl depth purposes.

How To Fix

  1. Audit your site structure: Map out how many clicks it takes to reach important pages from your homepage.

  2. Add direct links: Include links to important pages from high-authority pages like the homepage, main navigation, or top-level category pages.

  3. Simplify navigation: Reduce the number of menu levels and avoid burying important content in deep hierarchies.

  4. Use contextual links: Add inline text links within your content that point to related important pages.

  5. Check sitemap coverage: Ensure important pages are included in your XML sitemap as a fallback discovery method.

  6. Fix JavaScript navigation: If navigation relies on JavaScript, ensure fallback crawlable links exist in the HTML.

  7. Test after changes: Re-crawl your site to verify that important pages are now within 3 clicks of the homepage.

What We Store

Storage Level

Page Level — This issue is evaluated for each individual URL crawled.


Database Table / Prisma Model

Urls


Stored Fields

FieldTypeDescription
urlStringThe URL being analyzed
crawlDepthInt?The crawl depth of the URL (distance from start URL)

Detection Dependencies

  • The following data sources are required to evaluate this issue:
  • URL Queue — The crawler tracks the depth of each URL as it’s discovered
  • Crawl Graph — The relationship between parent and child URLs determines depth

Examples

Example 1: Deep Page Structure

Problematic State (Fails): A product page requires 5 clicks from the homepage:

Homepage → Categories → Electronics → Mobile Phones → Smartphones → iPhone 15

This is too deep for optimal crawlability.

Corrected State (Passes): Restructure to reduce click depth to 3 or fewer:

Homepage → Products → iPhone 15

Add direct links from the homepage or main navigation.


Example 2: Orphaned Page

Problematic State (Fails): A valuable page exists but has no internal links pointing to it:

  • The page /special-offer is not linked from any other page on the site
  • Users can only reach it via direct URL or external links

Corrected State (Passes): Add internal links to the page:

  • Link to /special-offer from the homepage
  • Include it in the main navigation or footer
  • Add contextual links from related content

Example 3: JavaScript Navigation

Problematic State (Fails): Navigation is generated only by JavaScript:

<div id="navigation"></div> <script> // Navigation links are created dynamically via JavaScript </script>

XeoPix cannot detect these links in raw HTML.

Corrected State (Passes): Add fallback HTML links:

<noscript> <a href="/products">Products</a> <a href="/about">About</a> </noscript> <!-- Or use progressive enhancement with actual HTML links -->

References

Last updated on