SEOSage

Crawler.sh is a fast, local-first web crawling and SEO analysis tool that enables users to crawl entire websites, extract clean content, and export structured data in seconds. It is available as both a command-line interface and a native desktop application, giving developers and SEO professionals flexibility depending on their workflow. It performs high-speed concurrent crawling within the same domain, with configurable depth limits, concurrency controls, and polite request delays suitable for large sites. It automatically extracts the main article content from pages and converts it into clean Markdown, including metadata such as word count, author byline, and excerpts. It also runs sixteen automated SEO checks per page to detect issues like missing titles, duplicate descriptions, thin content, long URLs, and noindex directives. Results can be streamed or exported in multiple formats, including NDJSON, JSON, Sitemap XML, CSV, and TXT.

TechSEO360 is an all-in-one technical SEO crawler software tool which can : - Fix broken links, broken redirects and broken canonical references. - Find pages with thin content, duplicate titles, duplicate headers, duplicate meta and similar content. - Analyze keywords across single pages or entire websites. - Create all kinds of sitemaps including HTML, XML, image and video including hreflang information. - Integrate with various 3d party data exports including Apache logs, Google Search Console and more. Data from those sources can then be combined with what TechSEO360 has collected to generate custom reports which can be exported to CSV and Excel. - Crawl very large websites. - Include searching Javascript code for links. - Use the software in AJAX mode for websites that require this. - Configure the crawler with both limit-to and exclude filters separately for analysis and output. - Use command line interface to schedule and automate most of the work.