Crawler.NET is a component-based distributed framework for web traversal intended for the .NET platform. It comprises of loosely coupled units each realizing a specific web crawler task. The main design goals are efficiency and flexibility.
License
GNU General Public License version 2.0 (GPLv2)Follow Crawler.NET
Other Useful Business Software
Veeam Data Platform v13.1 - Get Your Free Trial
Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
Rate This Project
Login To Rate This Project
User Reviews
-
Webcrawler is wonderful! Thanks.