Search Results for "scrapy-redis"

Roach is a complete web scraping toolkit for PHP. It is a shameless clone heavily inspired by the popular Scrapy package for Python. Roach allows us to define spiders that crawl and scrape web documents. But wait, there’s more. Roach isn’t just a simple crawler, but includes an entire pipeline to clean, persist and otherwise process extracted data as well. It’s your all-in-one resource for web scraping in PHP. Roach doesn’t depend on a specific framework. Instead, you can use the core package...

Golang-based distributed web crawler management platform, supporting various languages including Python, NodeJS, Go, Java, PHP and various web crawler frameworks including Scrapy, Puppeteer, Selenium. Please use docker-compose to one-click to start up. By doing so, you don't even have to configure MongoDB database. The frontend app interacts with the master node, which communicates with other components such as MongoDB, SeaweedFS and worker nodes. Master node and worker nodes communicate...

WinNMP - Nginx MariaDB Redis Php 8 development stack for Windows A lightweight, fast and stable server stack for developing php mysql applications on windows, based on the excellent webserver Nginx. A lighter alternative to XAMPP and WAMP. Also known as WTServer and wt-nmp Current Package contains the latest stable versions of: - Nginx web server - MariaDB 10 database server, mysql replacement (32/64bit) - MongoDB 4 document-based database (64bit) - Redis Cache/NoSql, memcached alternative...

A simple, one-file PHP based admin console and browser for Redis

... DBMS (MySQL, PostgreSQL, MongoDB, SQLite3 and Redis). Git (SCM) is included as well with some tools for code versioning and review. OPEW is fully binary independent compiled stack and fully portable In the future OPEW aims to be extensible using addons then can be installed in the same stack improving itself. Currently OPEW is still an experimental beta version.