PHPCrawl is a high configurable webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Project Activity

See All Activity >

Follow PHPCrawl

PHPCrawl Web Site

Other Useful Business Software

Identify and respond to threats before damage is done Icon
Identify and respond to threats before damage is done Icon

A SIEM that makes it easy to use logs for security, compliance, and troubleshooting.

SolarWinds® Log & Event Manager (LEM) delivers comprehensive Security Information and Event Management (SIEM) capabilities in a highly affordable, easy-to-use, and quick-to-deploy virtual appliance. LEM provides the visibility, security, and control that IT professionals need to alert on and respond to security threats, and assist in meeting the regulatory compliance guidelines of HIPAA, PCI DSS, SOX, and more. Try it FREE for 30 days!

Rate This Project

Login To Rate This Project

User Ratings

★★★★★
★★★★
★★★
★★
10
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

User Reviews

  • ***A*W*E*S*O*M*E***

  • Wow, this crawler has it all. It is - even with a point zero release faster and more mature and feature rich than every other I tried. Especially useful is the test interface, where you can try out all the parameters, without coding. This is excellent work!

    1 user found this review helpful.
  • Great tool to crawl sites, excelent support

  • Could use a "Per domain page-limit" :)

  • Very good job. Hard to find better!

Read more reviews >

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Web-based, Command-line

Programming Language

PHP

Registered

2003-09-04