Download
QueryList is an extensible PHP web scraping and crawling framework designed to extract and process data from web pages. It provides a simple and expressive API that allows developers to collect structured information from HTML documents using familiar DOM traversal techniques. It is built on top of phpQuery and uses CSS3 selectors similar to those found in jQuery, making it easy for developers to query and manipulate page elements during scraping tasks. QueryList supports common data extraction scenarios such as retrieving lists of titles, links, images, and other page elements from structured or semi-structured content. It also includes a powerful HTTP request system that enables complex operations such as simulated logins, proxy usage, and customized request headers. QueryList is designed with a modular architecture that allows developers to extend its capabilities through plugins for tasks.
Features
- CSS3 DOM selectors similar to jQuery for querying page elements
- DOM traversal and manipulation API for processing scraped content
- Generic list crawling system for extracting structured data from pages
- HTTP request tools supporting proxies, simulated login, and custom headers
- Plugin system enabling extensions such as multithreaded crawling or dynamic page scraping
- Content filtering and encoding handling to process extracted data
Project Samples
