LinkChecker
LinkChecker is a free, GPL licensed website validator. LinkChecker checks links in web documents or full websites. Check websites and HTML documents for broken links. ...
TechSEO360 essentially offers crawling of huge websites, collects and shows just about any technical SEO related information you want and can create all types of...
complete crawler tool for seo website audits including titles, descriptions, headers, duplicate content, keyword analysis, internal linking, anchor text, internal link juice flow, redirects, canonical and other kinds of references to files and urls.
can create all kinds of sitemaps including xml with hreflang information, video, image, rss/ror, text, custom html/css/javascript, dot for visualization graphs and more.
no fixed upper limit for number of urls in website practical limit depends but usually between 100.000 and 1.000.000 pages.
easy to filter scan results, view and export selected data to csv ready to be imported into other tools if so desired.
crawler engine can be highly configured to follow custom rules for which pages to crawl and which urls to include in results.
supports scheduling through a rich commandline interface.
Facebook
Official Website
Twitter
sitemap-generator search-engine-optimization site-link-validator website-checker link-scanner broken-links seo-spider crawling website-crawler google-sitemap
LinkChecker is a free, GPL licensed website validator. LinkChecker checks links in web documents or full websites. Check websites and HTML documents for broken links. ...
Free Open Source Windows Linux
Sitemap Generator is a free software that will help you to automatically generate sitemaps in google (XML) or yahoo (TXT) format or just to spider your website and...
Free Windows
A1 Website Analyzer can crawl websites and collect data to be used for finding site and SEO problems. Filter results to see which URLs are blocked by robots.txt, which...
Freemium
Meta Forensics is a website architecture, internal link and SEO analysis tool that helps identify unseen website problems on your website.
Freemium Web
DRKSpider is an open source website crawler (sitemap generator) and link checker. Features: Generates a website tree matching site's navigation hierarchy. ...
Free Open Source Mac OS X Windows Linux
A free online broken links checker for sites up to 1000 unique links which respects your robots.txt directive.
Free Web
Check for broken links on any website. Links that don't work damage your search rankings and provide for a poor user experience. No downloads - just enter the name...
Free Web
Free online broken link checker up to 3,000 web-pages (and unlimited number of links within those pages!). Will pinpoint broken link location in your HTML, so finding...
Freemium Web
Link Evaluator is a Firefox extension designed to help users evaluate the availability of online resources linked to from a given Web page. When started, it...
Free Mac OS X Windows Linux Firefox