PHPCrawl

PHPCrawl is a high configurable webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow PHPCrawl

PHPCrawl Web Site

Other Useful Business Software

Gen AI apps are built with MongoDB Atlas

The database for AI-powered applications.

MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.

Start Free

Rate This Project

User Ratings

5.0 out of 5 stars

★★★★★

★★★★

★★★

★★

★

ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5

design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

User Reviews

Filter Reviews:

All

mbenitez01 Posted 2016-03-02

***A*W*E*S*O*M*E***
marcodeluca Posted 2015-10-06

Wow, this crawler has it all. It is - even with a point zero release faster and more mature and feature rich than every other I tried. Especially useful is the test interface, where you can try out all the parameters, without coding. This is excellent work!

1 user found this review helpful.
jgrubenbecher Posted 2015-04-13

Great tool to crawl sites, excelent support
larsmqller Posted 2015-03-25

Could use a "Per domain page-limit" :)
michelre Posted 2014-12-04

Very good job. Hard to find better!

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Command-line, Web-based

Programming Language

PHP

Related Categories

PHP Search Engines, PHP Libraries

Registered

2003-09-04

Similar Business Software

JsPlumb

JsPlumb is a Javascript diagramming library that allows you to rapidly create complex applications featuring visual connectivity without having to build any of the boring stuff: it provides pan/zoom, a minimap widget, automatic layouts, data binding, path finding, and much, much more. JsPlumb...

See Software
Pintura

A fully configurable and client-side image editor SDK that's intuitive on mobile and desktop. Set image requirements and help your customers upload better pictures. Compatible with all popular JavaScript frameworks. Crop, rotate, resize, filter, annotate, adjust colors, and much...

See Software
JointJS

JointJS is a powerful JavaScript diagramming library that helps developers and companies of any size build advanced visual and No-Code applications. It comes in two versions: open-source (JointJS) with limited features and professional (JointJS+), which extends the features of JointJS and offers...

See Software
Voca

The Voca library offers helpful functions to make string manipulations comfortable: change case, trim, pad, slugify, latinise, sprintf'y, truncate, escape and much more. The modular design allows to load the entire library, or individual functions to minimize the application builds. The library...

See Software
Perplexity Max

Perplexity Max is Perplexity’s highest-tier subscription created for users who want expansive AI productivity and first access to the newest features. It offers unlimited usage in Labs, enabling users to build dashboards, spreadsheets, presentations, web apps, and more without the usual query...

See Software
Perplexity

Where knowledge begins. Perplexity is an AI search engine that gives you quick answers. Available for free at as a web app, desktop app, or on the go on iPhone or Android. Perplexity AI is an advanced search and question-answering tool that leverages large language models to provide...

See Software