Crawler.NET is a component-based distributed framework for web traversal intended for the .NET platform. It comprises of loosely coupled units each realizing a specific web crawler task. The main design goals are efficiency and flexibility.
License
GNU General Public License version 2.0 (GPLv2)Follow Crawler.NET
Other Useful Business Software
Get the most trusted enterprise browser
Defend against security incidents with Chrome Enterprise. Create customizable controls, manage extensions and set proactive alerts to keep your data and employees protected without slowing down productivity.
Rate This Project
Login To Rate This Project
User Reviews
-
Webcrawler is wonderful! Thanks.