LLight SEO Tools
Crawl helper

Extract links up to 3 levels deep.

Map the internal links connected to a starting page without uploading your site. Choose a crawl depth, then export the unique URLs found.

Start a crawl

This browser-based helper follows same-origin links from your starting URL.

Ready to crawl.

Extracted URLs

Unique internal links found by the crawl.

Browser limitation: some websites block direct browser requests with CORS. The crawler then retries through a public proxy, which is slower and can be rate-limited. For protected or large sites, request a processed crawl report.
Free crawl helper

Link Extractor

Enter a starting URL and the crawler follows same-origin links level by level, building a de-duplicated list of internal URLs. It is the fastest way to see the shape of a site without installing anything.

Step by step

  1. Paste the starting URL — usually the homepage or a section hub.
  2. Choose a crawl depth. One level scans only the start page, three levels builds a deeper internal map.
  3. Click Extract links and watch the status line as each level is fetched.
  4. Copy the unique URLs into your spreadsheet, crawler or index-submission tool.

Tips for better results

  • Depth 2 is usually enough to capture main navigation and section pages; depth 3 adds long-tail articles.
  • Compare the output with your sitemap.xml to find pages that exist but are never linked internally.
  • If a site blocks browser requests the crawler retries through a public proxy, which can be slower and rate-limited — a short result is usually CORS, not an empty site.

Frequently asked questions

Why does the crawl stop after a few pages?

Almost always because the site blocks cross-origin browser requests or renders links with JavaScript. The browser can only read pages the site is willing to share.

Is crawling a site from my browser safe?

Requests come from your own browser and your own connection, and the tool only follows internal links at the depth you choose. Keep depth modest and respect the target site's terms.

Can I crawl a very large website?

For protected, JavaScript-heavy or very large sites, request a processed crawl report. The offline workflow supports adjustable depth and much larger page budgets.

Related free SEO tools

Looking for another SEO tool?

Browse the full collection of free browser-based helpers or contact us with a general question.

Browse all tools