Most powerful, popular and production crawling/scraping package for Node, happy hacking.

Features

  • Server-side DOM & automatic jQuery insertion with Cheerio (default) or JSDOM
  • Configurable pool size and retries
  • Control rate limit
  • Priority queue of requests
  • forceUTF8 mode to let crawler deal for you with charset detection and conversion
  • Compatible with 4.x or newer version

Project Samples

Node Crawler Screenshot 1

Project Activity

See All Activity >

Categories

Libraries

License

MIT License

Follow Node Crawler

Node Crawler Web Site

You Might Also Like
Achieve perfect load balancing with a flexible Open Source Load Balancer Icon
Achieve perfect load balancing with a flexible Open Source Load Balancer

Take advantage of Open Source Load Balancer to elevate your business security and IT infrastructure with a custom ADC Solution.

Boost application security and continuity with SKUDONET ADC, our Open Source Load Balancer, that maximizes IT infrastructure flexibility. Additionally, save up to $470 K per incident with AI and SKUDONET solutions, further enhancing your organization’s risk management and cost-efficiency strategies.
Learn More
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Node Crawler!

Additional Project Details

Programming Language

JavaScript

Related Categories

JavaScript Libraries

Registered

2023-09-20
Report inappropriate content