Site Explorer preview

Site Explorer

Enter a domain to get 14 links that open it in search engines, the Wayback Machine, WHOIS, DNS and SSL checkers, and page speed tools. Your last 10 domains are saved in your browser.

Key features

  • Site: search links for Google, Bing, Yandex and DuckDuckGo
  • Wayback Machine, WHOIS, DNS, SSL and SecurityTrails links
  • PageSpeed Insights, GTMetrix, WebPageTest and Lighthouse links
  • Last 10 domains saved in your browser, with copy and clear buttons

Guide

Site architecture is the way your website's pages are organized and connected. It affects how search engines crawl and index your content, how link authority flows between pages, and how users navigate your site. A flat, well-structured architecture makes every important page reachable within a few clicks from the homepage. A deep, disorganized architecture buries content where search engines may never find it and users will never reach it. This guide covers how to analyze and improve your site structure using sitemap data.

A sitemap is an XML file that lists the URLs on your website. It tells search engines which pages exist, when they were last modified, how frequently they change, and their relative priority. While search engines can discover pages through crawling (following links), a sitemap ensures they know about every page, including those that might be poorly linked. The standard location for a sitemap is yourdomain.com/sitemap.xml, and it should be referenced in your robots.txt file.

Sitemap XML follows a specific structure. The urlset element contains url elements, each with a loc (URL), lastmod (last modification date), changefreq (how often the page changes), and priority (relative importance from 0.0 to 1.0). Large sites use sitemap index files that reference multiple individual sitemaps, each limited to 50,000 URLs or 50MB. Understanding this structure helps you evaluate whether your sitemap accurately represents your site.

The WebRecast site explorer gives you a starting point for this analysis. Enter a domain and it builds 14 links in three groups. The search engine group has Google site:, Google indexed pages, Bing, Yandex and DuckDuckGo, so you can compare how many of your pages each one shows. The archive group has the Wayback Machine, WHOIS, DNS lookup, SSL checker and SecurityTrails. The performance group has PageSpeed Insights, GTMetrix, WebPageTest and a Lighthouse report. Use the Wayback Machine link to see how your site structure looked in past snapshots.

URL structure should mirror your site hierarchy. A well-organized URL structure groups related content under common directories. domain.com/products/shoes/running-shoes is logically organized. domain.com/p/12345 tells neither users nor search engines anything about the page. When you visualize your URLs as a tree, you can see whether your URL structure creates logical groupings or a flat mess of unrelated paths.

Crawl depth is the number of clicks required to reach a page from the homepage. Pages at crawl depth 1 are linked directly from the homepage. Pages at depth 2 are one click further away, and so on. Search engines give more crawl attention and typically more ranking weight to pages at shallow depths. A common recommendation is that every important page should be reachable within 3 clicks from the homepage. Sorting your sitemap URLs by folder shows you which pages sit deep in your hierarchy and might need better internal linking to reduce their effective crawl depth.

Directory size distribution tells you how content is spread across your site sections. If your blog directory has 500 URLs and your product directory has 20, that imbalance might be intentional or it might indicate that your product pages need expansion. If one directory has thousands of near-duplicate URLs (common with faceted navigation on e-commerce sites), that could waste crawl budget and create duplicate content issues. Counting sitemap URLs per directory in a spreadsheet makes these distributions visible.

Orphan pages are pages that exist on your site but have no internal links pointing to them. If a page appears in your sitemap but is not connected to any other page through internal links, search engines may find it through the sitemap but will not assign it much importance because it lacks internal link authority. Comparing your sitemap with your internal links helps identify sections of your site that are poorly connected. If a section has pages that you know are important but appear isolated in the structure, you need to add internal links from related pages.

URL count analysis by directory helps with content planning. See which topic areas on your site have extensive coverage and which are thin. If your competitor analysis shows they have 100 pages covering a topic where you have 10, that content gap explains a competitive disadvantage. Counting URLs per directory quantifies your content distribution and highlights where expansion would be most valuable.

Flat versus deep architecture is a fundamental structural decision. A flat architecture (most pages at depth 1 or 2) ensures all content gets crawled and receives link authority but can feel overwhelming for large sites. A deep architecture (content organized into nested categories and subcategories) provides clear organization but risks burying content too deep. Most sites use a hybrid approach: main categories at depth 1, subcategories at depth 2, and individual content pages at depth 3. The folder depth of your sitemap URLs gives a rough view of where your site falls on this spectrum.

Hub pages (also called pillar pages or category pages) are the structural backbone of a well-organized site. A hub page for a topic links to all related content pages and serves as the central resource for that topic cluster. In a folder view of your URLs, hub pages appear as directories with many child pages. If a directory has many child pages but the directory index page (the hub) does not link to them prominently, you are missing a structural optimization opportunity.

Site structure changes require careful planning. If your analysis reveals structural problems and you decide to reorganize URLs, you must implement 301 redirects from old URLs to new ones. Changing URLs without redirects results in 404 errors, lost backlinks, and lost rankings. Map every old URL to its new location, implement redirects server-side (in nginx, Apache, or your CDN), and update your sitemap to reflect the new structure. Then submit the updated sitemap to Google Search Console.

Large sites with thousands or tens of thousands of pages often have structural problems that are invisible when looking at pages individually but become obvious when you group the URLs by folder. URL parameter pollution (the same page accessible at hundreds of parameterized URLs), trailing slash inconsistencies (/page/ versus /page), www versus non-www duplicates, and HTTP versus HTTPS duplicates all show up as extra URL groups that should not exist.

Subdomain versus subdirectory is a structural decision that affects SEO. Content on blog.domain.com is technically a separate site from domain.com/blog in terms of how search engines evaluate it. Subdirectories consolidate all content under one domain, pooling authority. Subdomains split authority. The general SEO recommendation is to use subdirectories unless there is a strong technical reason for subdomains. Run a site: search for each subdomain with this tool to compare how many pages each one has indexed.

International site structure for multilingual sites typically uses one of three patterns: country-code top-level domains (example.de, example.fr), subdomains (de.example.com), or subdirectories (example.com/de/). Each approach has tradeoffs in terms of SEO signal consolidation, hosting complexity, and management overhead. The subdirectory approach keeps everything under one domain and is the simplest to manage. In a folder view of your sitemap, language directories appear as top-level folders, and you can verify that each language version has equivalent content coverage.

Pagination structure affects how search engines handle multi-page content series. Category pages with paginated results (page 1, page 2, page 3) appear in a sitemap as siblings within the same directory. If pagination creates hundreds of nearly identical pages, it may waste crawl budget. Consider whether all paginated pages need to be in the sitemap or whether only the first page should be included.

The WebRecast site explorer does not fetch or parse anything itself. It checks that your domain is valid, strips http, https, paths and www, and builds the links in your browser. When you open a link, your domain goes to that service, such as Google, the Wayback Machine or PageSpeed Insights, under its own privacy terms. Your last 10 domains are saved in your browser storage, and you can remove one or clear the list.

Regular structural analysis should be part of your SEO maintenance routine. As you add content, your site structure evolves. New sections grow, old sections may become neglected, and the overall architecture can drift from its intended design. A quarterly sitemap review helps you stay on top of structural changes and maintain an architecture that supports both search engine crawling and user navigation.

Frequently asked questions

What do I enter?

Enter a domain such as example.com. The tool removes http, https, www and any path, checks the format, and builds the links.

Does the tool fetch data about my site?

No. It only builds links. When you open one, your domain goes to that service, which runs the check and shows the result on its own site.

Related guides

Related WebRecast sections