Netpeak Spider
Netpeak Spider is an SEO crawler for a day-to-day SEO audit, fast issue check, comprehensive analysis, and website scraping.
This tool allows you to:
* Spot 100+ issues of your website optimization.
* Check 80+ key on-page SEO parameters.
* Calculate internal PageRank to improve website linking structure.
* Analyze all incoming and outgoing internal links.
* View page source and HTTP headers.
* Generate sitemaps: XML, Image and HTML.
* Adjust Netpeak Spider to your own requirements using crawling modes for the entire website, the URL list or XML Sitemap.
* Set custom rules to crawl either the entire website or its certain part
* Consider indexation instructions (Robots.txt, Meta Robots, X-Robots-Tag, Canonical)
* Perform custom search of source code/text using 4 types of search.
* Avoid duplicate content: Pages, Titles, Meta Descriptions, H1 Headers, etc.
* Spot issues with redirects.
* Overview panel for fast SEO audit with special status codes which show website
Learn more about Netpeak Spider
SEOpeck
SEOpeck is a free, browser-based collection of online tools for website owners, SEO specialists, marketers, developers, and people handling everyday file tasks. Its SEO and web tools check on-page metadata, crawl sites for audit issues, test links and speed, preview search snippets, validate structured data, and inspect robots.txt and AI crawler access. Other tools help users merge, split, compress, sign, and convert PDFs; compress, resize, convert, or remove backgrounds from images; and work with video, audio, documents, text, network lookups, and code. The site also offers JSON, regex, JWT, DNS, email-authentication, and IP tools. A companion Chrome and Edge extension provides one-click SEO checks for the current page. The browser-based tools can be used without creating an account.
Learn more about SEOpeck
CitedBy
CitedBy checks whether Google and AI crawlers can read your website. It crawls your site up to your plan's page limit and gives a fix for each issue, with the tag, robots.txt line or schema block to paste where there is one. A problem repeated on 100 pages is shown as one fix with the page count, not 100 errors. Checks cover indexing risk (template floods, noindex URLs in the sitemap, near-duplicate pages), broken links, redirect chains and canonicals, titles, headings and schema, pages that arrive empty until JavaScript runs, and access for OAI-SearchBot (ChatGPT search), GPTBot, ClaudeBot and PerplexityBot, with one live request each. The free check covers up to 10 pages with no account and no card. The full site audit (up to 500 pages) is €9 once, with a 14-day money-back guarantee.
Learn more about CitedBy
Tarantula SEO Spider
Tarantula SEO Spider is your go-to solution for all SEO audit requirements. This AI-powered marvel stands out as the premier SEO spider and crawler. Tarantula swiftly navigates websites, uncovering and extracting valuable insights to help improve your ranking. The integration of AI in Tarantula SEO Crawler allows you to discover the authentic keywords targeted by any webpage. Tarantula provides all the essential information you need to boost your website's ranking, making it a powerful tool for enhancing your online presence.
Features
AI Analyzer - Find the true keywords targeted by any page.
AI Rewriter - Rewrite any page with the click of a button
Find broken links, redirects, and other issues.
Analyze Meta descriptions, titles, and keywords.
View Robots.txt and search engine directives.
Find duplicate pages, content, and meta.
View and generate sitemaps.
Pause and resume crawls at any time.
View site structure and site plans
Charts and graphs make data visualization
Learn more about Tarantula SEO Spider