PHPCrawl is a high configurable webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Project Activity

See All Activity >

Follow PHPCrawl

PHPCrawl Web Site

Other Useful Business Software

Use DigitalOcean to Build, Deploy & Scale Web Apps Use DigitalOcean to Build, Deploy & Scale Web Apps Icon
Use DigitalOcean to Build, Deploy & Scale Web Apps Icon

The ease and simplicity of DigitalOcean gives developers more time to build and innovate for their customers.

Thousands of businesses and developers around the world use DigitalOcean to easily deploy, manage, and scale applications of any size with less infrastructure friction. Go from one to a thousand virtual servers in seconds. Also, we continue to add hundreds of in-depth tutorials to our documentation library and have an active online community to get the support you need to succeed.

Rate This Project

Login To Rate This Project

User Ratings

★★★★★
★★★★
★★★
★★
10
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

User Reviews

  • ***A*W*E*S*O*M*E***

  • Wow, this crawler has it all. It is - even with a point zero release faster and more mature and feature rich than every other I tried. Especially useful is the test interface, where you can try out all the parameters, without coding. This is excellent work!

    1 user found this review helpful.
  • Great tool to crawl sites, excelent support

  • Could use a "Per domain page-limit" :)

  • Very good job. Hard to find better!

Read more reviews >

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Web-based, Command-line

Programming Language

PHP

Registered

2003-09-04