Crawler.NET is a component-based distributed framework for web traversal intended for the .NET platform. It comprises of loosely coupled units each realizing a specific web crawler task. The main design goals are efficiency and flexibility.

Project Activity

See All Activity >

Categories

Search Engines, Web Scrapers

License

GNU General Public License version 2.0 (GPLv2)

Follow Crawler.NET

Crawler.NET Web Site

Other Useful Business Software
Endpoint Management with Remote Control Built In Icon
Endpoint Management with Remote Control Built In

Patch, monitor, and connect to Windows and macOS devices from one console

Splashtop AEM handles patching, alerts, scripts, and inventory, and unattended remote control is included. When something needs hands-on work, you’re one click away instead of switching tools.
Start Free Trial
Rate This Project
Login To Rate This Project

User Ratings

5.0 out of 5 stars
★★★★★
★★★★
★★★
★★
★
1
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5

User Reviews

Filter Reviews:
All
  • jamesperalta Posted 2013-06-24
    5 out of 5 stars
    Webcrawler is wonderful! Thanks.
    1 user found this review helpful.
Read more reviews >

Additional Project Details

Intended Audience

Developers, Science/Research

User Interface

.NET/Mono

Programming Language

C#

Database Environment

Microsoft SQL Server

Related Categories

C# Search Engines, C# Web Scrapers

Registered

2006-02-10
Report inappropriate content