PHPCrawl is a high configurable webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Project Activity

See All Activity >

Categories

Search Engines, Libraries

License

GNU General Public License version 2.0 (GPLv2)

Follow PHPCrawl

PHPCrawl Web Site

You Might Also Like
Top-Rated Free CRM Software Icon
Top-Rated Free CRM Software

216,000+ customers in over 135 countries grow their businesses with HubSpot

HubSpot is an AI-powered customer platform with all the software, integrations, and resources you need to connect your marketing, sales, and customer service. HubSpot's connected platform enables you to grow your business faster by focusing on what matters most: your customers.
Get started free
Rate This Project
Login To Rate This Project

User Ratings

5.0 out of 5 stars
★★★★★
★★★★
★★★
★★
★
8
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

User Reviews

Filter Reviews:
★★★★★
  • mbenitez01 Posted 2016-03-02
    ***A*W*E*S*O*M*E***
  • marcodeluca Posted 2015-10-06
    Wow, this crawler has it all. It is - even with a point zero release faster and more mature and feature rich than every other I tried. Especially useful is the test interface, where you can try out all the parameters, without coding. This is excellent work!
    1 user found this review helpful.
  • jgrubenbecher Posted 2015-04-13
    Great tool to crawl sites, excelent support
  • larsmqller Posted 2015-03-25
    Could use a "Per domain page-limit" :)
  • michelre Posted 2014-12-04
    Very good job. Hard to find better!
Read more reviews >

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Web-based, Command-line

Programming Language

PHP

Related Categories

PHP Search Engines, PHP Libraries

Registered

2003-09-04
Report inappropriate content