CrawlGraph

CrawlGraph

Search Engine Wizards
+
+

Related Products

  • InboxAlly
    135 Ratings
    Visit Website
  • HubSpot AEO
    47 Ratings
    Visit Website
  • Birdeye
    5,192 Ratings
    Visit Website
  • DNSimple
    75 Ratings
    Visit Website
  • Criminal IP ASM
    21 Ratings
    Visit Website
  • DataHub
    10 Ratings
    Visit Website
  • one.com
    32 Ratings
    Visit Website
  • Total ETO
    45 Ratings
    Visit Website
  • Mentornity
    99 Ratings
    Visit Website
  • Secure Eraser
    15 Ratings
    Visit Website

About

CrawlGraph uses Common Crawl's open hyperlink graph to help SEOs research referring domains. Anyone can check a domain and see five referring domains free without an account. Paid access unlocks the full result slice, CSV and JSON exports, and competitor gap analysis across up to four competitors. A public REST API and crawlgraph-mcp give scripts and AI agents access to backlink lookups, gap analysis, outreach targets, and release metadata. Results come from named Common Crawl releases, not a live crawl. Lifetime access is a one-time payment; a separate optional SEO Fix addon sends a monthly suggested fix.

About

Crawler.sh is a fast, local-first web crawling and SEO analysis tool that enables users to crawl entire websites, extract clean content, and export structured data in seconds. It is available as both a command-line interface and a native desktop application, giving developers and SEO professionals flexibility depending on their workflow. It performs high-speed concurrent crawling within the same domain, with configurable depth limits, concurrency controls, and polite request delays suitable for large sites. It automatically extracts the main article content from pages and converts it into clean Markdown, including metadata such as word count, author byline, and excerpts. It also runs sixteen automated SEO checks per page to detect issues like missing titles, duplicate descriptions, thin content, long URLs, and noindex directives. Results can be streamed or exported in multiple formats, including NDJSON, JSON, Sitemap XML, CSV, and TXT.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

SEO professionals, digital marketers, link-building agencies, content teams, and founders

Audience

Developers, SEO specialists, and technical marketers who need a fast local tool to crawl websites, audit SEO, and extract structured content

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

No images available

Screenshots and Videos

Pricing

$19/month
Free Version
Free Trial

Pricing

$99 per year
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Search Engine Wizards
Finland
crawlgraph.com

Company Information

Crawler.sh
United States
crawler.sh/

Alternatives

No Alternatives

Alternatives

Categories

SEO

Categories

Integrations

Google Sheets
JSON
Markdown
Microsoft Excel
XML

Integrations

Google Sheets
JSON
Markdown
Microsoft Excel
XML
Claim CrawlGraph and update features and information
Claim CrawlGraph and update features and information
Claim Crawler.sh and update features and information
Claim Crawler.sh and update features and information