A high-performance web crawling and scraping framework for Node.js, designed for large-scale data extraction.

Features

  • Supports concurrent and distributed web crawling
  • Open-source and optimized for large-scale scraping tasks
  • Provides built-in request throttling and rate limiting
  • Allows customizable scraping rules and data extraction patterns
  • Works with proxies for anonymous crawling
  • Supports headless browser automation with Puppeteer integration

Project Samples

Project Activity

See All Activity >

Categories

Libraries

License

MIT License

Follow X-Crawl

X-Crawl Web Site

Other Useful Business Software
Train ML Models With SQL You Already Know Icon
Train ML Models With SQL You Already Know

BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of X-Crawl!

Additional Project Details

Programming Language

TypeScript

Related Categories

TypeScript Libraries

Registered

2025-02-14