Website Links Generator - List and check every link on a website (Updated Oct 2026)


Description:
Website Links Generator crawls a website and lists every link it finds: pages, pictures, stylesheets, scripts, downloads, email addresses, phone numbers and links to other websites. It can then check every link and show which ones work, which redirect and which are broken, so it is a quick way to find broken links, build a list of a site's pages, or see which other sites a website links to.

It finds more than a simple link scrape: it follows references inside stylesheets (so images and fonts used by CSS are found), spots lazy-loaded images and scripts (data-src, srcset and similar), and can import every address listed in the site's XML sitemap. The results can be filtered, copied, and exported to TXT, CSV, JSON or HTML.

How to use:


1. Enter the website address in URL, for example https://www.example.com.

2. Set how far to go: Max pages (how many pages to read), Max depth (how many clicks away from the first page) and Delay (ms) between pages, to be gentle on the website. Include regex and Exclude regex limit which addresses are followed, Mode chooses plain HTTP (fast) or a rendered page for sites that build their links with JavaScript, and Threads sets how many pages are read at once.

3. Click Get Links. The list fills as the crawl runs; use Pause and Stop to control it.

4. Each row shows the Link, its Type (page, picture, stylesheet, script, email and so on, and whether it is internal or external), the Depth it was found at and its Status. Click a link to open it, or right-click for more options.

5. Click Check Links to test every link. The Status column shows the result: green for working links, red for broken ones (4xx/5xx).

6. Use the Show and Status tick boxes, the Type list and the Filter box (tick Regex filter for patterns) to show just the links you want; the count on the right shows how many are listed.

7. Click Import Sitemap to add every address from the site's XML sitemap (found through robots.txt or the usual sitemap locations), and Robots.txt to see which parts of the site ask not to be crawled.

8. Open the Domain Summary tab to see which other websites the site links to, how many links go to each and their share of all external links.



9. Click Copy to Clipboard, or Export TXT, Export CSV, Export JSON or Export HTML to save the links that are shown.

Note: "example.com" and "www.example.com" count as the same website. Some sites refuse automated checks and report an error (such as 403) for links that work in a browser.


What You Can Do With This Program

Website Auditing and Health Checks:

• Finding Broken Links (404s): You can use the exported list with a separate tool (or manually check a sample) to see if any of the collected URLs return a "Page Not Found" (404) error. This is crucial for user experience and SEO.


• Identifying Redirect Chains: Check for URLs that redirect multiple times (e.g., A -> B -> C). Long redirect chains can slow down page loading and confuse search engines.


• Spotting Orphaned Pages: If you compare your collected URLs with a list of pages you expect to be linked internally, you can find pages that aren't linked from anywhere else on the site, making them hard for users and search engines to find.

Search Engine Optimization (SEO):

• Sitemap Generation: The collected URLs are a fundamental building block for creating or updating an XML sitemap, which tells search engines about all the pages on your site.


• Indexation Monitoring: You can regularly collect URLs and compare them to previous scans to see if new pages are being discovered and old ones are disappearing as expected.


• Content Inventory: Get a complete list of all your content. This helps in strategizing content updates, identifying content gaps, or performing a content audit.


• Migration Planning: When redesigning or migrating a website, this list is invaluable for ensuring all old URLs are properly mapped to new ones via redirects, preventing loss of SEO value.

Website Migration and Redesign:

• URL Mapping: Absolutely essential for creating 301 redirect maps from old URLs to new URLs during a site migration. This prevents users hitting 404s and preserves SEO rankings.


• Content Checklist: Ensure all content from the old site is accounted for and moved or redirected appropriately on the new site.

Content Management and Strategy:

• Content Audit: Review all existing content. Is it still relevant? Does it need updating? Is it performing well?


• Identifying Duplicate Content: If you're seeing very similar URLs or content across multiple pages, this list helps identify potential duplicate content issues.


• Planning Content Hierarchy: Understand how pages are structured and linked, which can inform future content organization.

Quality Assurance (QA) and Testing:

• Pre-Deployment Checks: Before launching a new section or site, use your tool to crawl and verify that all expected pages are live and accessible.


• Load Testing Preparation: For larger sites, a comprehensive list of URLs can be fed into load testing tools to simulate user traffic across the entire site.

Competitive Analysis (Ethical Use):

• Understanding Competitor Structure: While you should always respect robots.txt and website terms of service, in general, publicly available URLs can give you insights into how a competitor structures their content or specific product pages (though this usually requires the site to allow crawling).

Data Extraction (Ethical Use):

• Preparation for Scraping: If you plan to ethically scrape data from specific pages (e.g., product details from an e-commerce site where you have permission or it's publicly allowed), your URL list provides the targets for your scraper.

Link Building and Outreach:

• Prospect List: For outreach efforts, if you're looking for pages on a specific topic within a domain, this tool can help you collect those specific URLs quickly.