PHPCrawl is a high configurable webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Project Activity

See All Activity >

Follow PHPCrawl

PHPCrawl Web Site

Other Useful Business Software

Find out what (or who) is slowing down your network Find out what (or who) is slowing down your network Icon
Find out what (or who) is slowing down your network Icon

Get comprehensive network bandwidth analysis and performance monitoring with SolarWinds® Bandwidth Analyzer Pack.

Network slow, but you don't know the cause? Use Bandwidth Analyzer Pack (BAP) to monitor and analyze network bandwidth performance and traffic patterns. With BAP, you can identify which users, applications, and protocols are consuming the most bandwidth. You can also monitor Wireless LAN Controller traffic to see what applications and clients are using your wireless network. Try it free for 30 days!

Rate This Project

Login To Rate This Project

User Ratings

★★★★★
★★★★
★★★
★★
10
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

User Reviews

  • ***A*W*E*S*O*M*E***

  • Wow, this crawler has it all. It is - even with a point zero release faster and more mature and feature rich than every other I tried. Especially useful is the test interface, where you can try out all the parameters, without coding. This is excellent work!

    1 user found this review helpful.
  • Great tool to crawl sites, excelent support

  • Could use a "Per domain page-limit" :)

  • Very good job. Hard to find better!

Read more reviews >

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Web-based, Command-line

Programming Language

PHP

Registered

2003-09-04