PHPCrawl is a high configurable webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Project Activity

See All Activity >

Categories

Search Engines, Libraries

License

GNU General Public License version 2.0 (GPLv2)

Follow PHPCrawl

PHPCrawl Web Site

Other Useful Business Software
Turn PDFs into postal mail Icon
Turn PDFs into postal mail

Postal Mail Solutions for Digital Workplaces.

Click2Mail transforms conventional mail with its online and on-demand, SaaS print-to-mail service.
Learn More
Rate This Project
Login To Rate This Project

User Ratings

5.0 out of 5 stars
★★★★★
★★★★
★★★
★★
★
8
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

User Reviews

Filter Reviews:
All
  • mbenitez01 Posted 2016-03-02
    ***A*W*E*S*O*M*E***
  • marcodeluca Posted 2015-10-06
    Wow, this crawler has it all. It is - even with a point zero release faster and more mature and feature rich than every other I tried. Especially useful is the test interface, where you can try out all the parameters, without coding. This is excellent work!
    1 user found this review helpful.
  • jgrubenbecher Posted 2015-04-13
    Great tool to crawl sites, excelent support
  • larsmqller Posted 2015-03-25
    Could use a "Per domain page-limit" :)
  • michelre Posted 2014-12-04
    Very good job. Hard to find better!
Read more reviews >

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Web-based, Command-line

Programming Language

PHP

Related Categories

PHP Search Engines, PHP Libraries

Registered

2003-09-04
Report inappropriate content