PHPCrawl

PHPCrawl is a high configurable webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow PHPCrawl

PHPCrawl Web Site

nel_h2

Secure User Management, Made Simple | Frontegg

Get 7,500 MAUs, 50 tenants, and 5 SSOs free – integrated into your app with just a few lines of code.

Frontegg powers modern businesses with a user management platform that’s fast to deploy and built to scale. Embed SSO, multi-tenancy, and a customer-facing admin portal using robust SDKs and APIs – no complex setup required. Designed for the Product-Led Growth era, it simplifies setup, secures your users, and frees your team to innovate. From startups to enterprises, Frontegg delivers enterprise-grade tools at zero cost to start. Kick off today.

Start for Free

Rate This Project

User Ratings

5.0 out of 5 stars

★★★★★

★★★★

★★★

★★

★

ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5

design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

User Reviews

Filter Reviews:

All

mbenitez01 Posted 2016-03-02

***A*W*E*S*O*M*E***
marcodeluca Posted 2015-10-06

Wow, this crawler has it all. It is - even with a point zero release faster and more mature and feature rich than every other I tried. Especially useful is the test interface, where you can try out all the parameters, without coding. This is excellent work!

1 user found this review helpful.
jgrubenbecher Posted 2015-04-13

Great tool to crawl sites, excelent support
larsmqller Posted 2015-03-25

Could use a "Per domain page-limit" :)
michelre Posted 2014-12-04

Very good job. Hard to find better!

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Command-line, Web-based

Programming Language

PHP

Related Categories

PHP Search Engines, PHP Libraries

Registered

2003-09-04

Similar Business Software

JsPlumb

JsPlumb is a Javascript diagramming library that allows you to rapidly create complex applications featuring visual connectivity without having to build any of the boring stuff: it provides pan/zoom, a minimap widget, automatic layouts, data binding, path finding, and much, much more. JsPlumb...

See Software
Pintura

A fully configurable and client-side image editor SDK that's intuitive on mobile and desktop. Set image requirements and help your customers upload better pictures. Compatible with all popular JavaScript frameworks. Crop, rotate, resize, filter, annotate, adjust colors, and much...

See Software
JointJS

JointJS is a powerful JavaScript diagramming library that helps developers and companies of any size build advanced visual and No-Code applications. It comes in two versions: open-source (JointJS) with limited features and professional (JointJS+), which extends the features of JointJS and offers...

See Software
Voca

The Voca library offers helpful functions to make string manipulations comfortable: change case, trim, pad, slugify, latinise, sprintf'y, truncate, escape and much more. The modular design allows to load the entire library, or individual functions to minimize the application builds. The library...

See Software
Underscore.js

Underscore is a JavaScript library that provides a whole mess of useful functional programming helpers without extending any built-in objects. Underscore provides over 100 functions that support both your favorite workaday functional helpers like map, filter, and invoke, as well as more...

See Software
Perplexity

Where knowledge begins. Perplexity is an AI search engine that gives you quick answers. Available for free at as a web app, desktop app, or on the go on iPhone or Android. Perplexity AI is an advanced search and question-answering tool that leverages large language models to provide...

See Software