PHPCrawl

PHPCrawl is a high configurable webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow PHPCrawl

PHPCrawl Web Site

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Rate This Project

User Ratings

5.0 out of 5 stars

★★★★★

★★★★

★★★

★★

★

ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5

design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

User Reviews

Filter Reviews:

All

mbenitez01 Posted 2016-03-02

***A*W*E*S*O*M*E***
marcodeluca Posted 2015-10-06

Wow, this crawler has it all. It is - even with a point zero release faster and more mature and feature rich than every other I tried. Especially useful is the test interface, where you can try out all the parameters, without coding. This is excellent work!

1 user found this review helpful.
jgrubenbecher Posted 2015-04-13

Great tool to crawl sites, excelent support
larsmqller Posted 2015-03-25

Could use a "Per domain page-limit" :)
michelre Posted 2014-12-04

Very good job. Hard to find better!

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Command-line, Web-based

Programming Language

PHP

Related Categories

PHP Search Engines, PHP Libraries

Registered

2003-09-04

Similar Business Software

JsPlumb

JsPlumb is a Javascript diagramming library that allows you to rapidly create complex applications featuring visual connectivity without having to build any of the boring stuff: it provides pan/zoom, a minimap widget, automatic layouts, data binding, path finding, and much, much more. JsPlumb...

See Software
Pintura

A fully configurable and client-side image editor SDK that's intuitive on mobile and desktop. Set image requirements and help your customers upload better pictures. Compatible with all popular JavaScript frameworks. Crop, rotate, resize, filter, annotate, adjust colors, and much...

See Software
JointJS

JointJS is a powerful JavaScript diagramming library that helps developers and companies of any size build advanced visual and No-Code applications. It comes in two versions: open-source (JointJS) with limited features and professional (JointJS+), which extends the features of JointJS and offers...

See Software
Voca

The Voca library offers helpful functions to make string manipulations comfortable: change case, trim, pad, slugify, latinise, sprintf'y, truncate, escape and much more. The modular design allows to load the entire library, or individual functions to minimize the application builds. The library...

See Software
Perplexity Max

Perplexity Max is Perplexity’s highest-tier subscription created for users who want expansive AI productivity and first access to the newest features. It offers unlimited usage in Labs, enabling users to build dashboards, spreadsheets, presentations, web apps, and more without the usual query...

See Software
Underscore.js

Underscore is a JavaScript library that provides a whole mess of useful functional programming helpers without extending any built-in objects. Underscore provides over 100 functions that support both your favorite workaday functional helpers like map, filter, and invoke, as well as more...

See Software