Crawler.NET is a component-based distributed framework for web traversal intended for the .NET platform. It comprises of loosely coupled units each realizing a specific web crawler task. The main design goals are efficiency and flexibility.

Project Activity

See All Activity >

Categories

Search Engines, Web Scrapers

License

GNU General Public License version 2.0 (GPLv2)

Follow Crawler.NET

Crawler.NET Web Site

You Might Also Like
Our Free Plans just got better! | Auth0 by Okta Icon
Our Free Plans just got better! | Auth0 by Okta

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your secuirty. Auth0 now, thank yourself later.
Try free now
Rate This Project
Login To Rate This Project

User Ratings

5.0 out of 5 stars
★★★★★
★★★★
★★★
★★
★
1
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5

User Reviews

Filter Reviews:
All
  • jamesperalta Posted 2013-06-24
    Webcrawler is wonderful! Thanks.
    1 user found this review helpful.
Read more reviews >

Additional Project Details

Intended Audience

Science/Research, Developers

User Interface

.NET/Mono

Programming Language

C#

Database Environment

Microsoft SQL Server

Related Categories

C# Search Engines, C# Web Scrapers

Registered

2006-02-10
Report inappropriate content