Search Results for "scrapy-redis"
Sort By:
Showing 33 open source projects for "scrapy-redis"
View related business solutions-
HubSpot is an AI-powered customer platform with all the software, integrations, and resources you need to connect your marketing, sales, and customer service. HubSpot's connected platform enables you to grow your business faster by focusing on what matters most: your customers.
-
Simplify every aspect of buying for your business in Order.co. From sourcing products to scaling purchasing across locations to automating your AP and approvals workstreams, Order.co is the platform of choice for growing businesses.
-
1
PHP-Casbin
An authorization library that supports access control models
.... Besides memory and file, Casbin policy can be stored into lots of places. Currently, dozens of databases are supported, from MySQL, Postgres, Oracle to MongoDB, Redis, Cassandra, AWS S3. Check the full supported list at: adapters. Casbin is implemented in Golang, Java, PHP and Node.js. All implementations share the same API and behaviors. You can learn Casbin once and use it everywhere. -
2
Lada Cache
A Redis based, fully automated and scalable database cache layer
A Redis-based, fully automated, and scalable database cache layer for Laravel. -
3
EasyEngine
Command-line control panel for Nginx Server to manage WordPress sites
EasyEngine makes it greatly easy to manage nginx, a fast web-server software that consumes little memory when handling increasing volumes of concurrent users. -
4
Roach
The complete web scraping toolkit for PHP
Roach is a complete web scraping toolkit for PHP. It is a shameless clone heavily inspired by the popular Scrapy package for Python. Roach allows us to define spiders that crawl and scrape web documents. But wait, there’s more. Roach isn’t just a simple crawler, but includes an entire pipeline to clean, persist and otherwise process extracted data as well. It’s your all-in-one resource for web scraping in PHP. Roach doesn’t depend on a specific framework. Instead, you can use the core package... -
Don’t settle when it comes to managing your clients’ IT infrastructure. Exceed their expectations with ConnectWise RMM, our MSP RMM software that provides proactive tools and NOC services—regardless of device environment. With the number of new vulnerabilities rising each year, smart patching procedures have never been more important. We automatically test and deploy patches when they are viable and restrict patches that are harmful. Get better protection for clients while you spend less time managing endpoints and more time growing your business. It’s tough to locate, afford, and retain quality talent. In fact, 81% of IT leaders say it’s hard to find the recruits they need. Add ConnectWise RMM, NOC services and get the expertise and problem resolution you need to become the advisor your clients demand—without adding headcount.
-
5
Laravel Wave
Painless Laravel Broadcasting with SSE
Unlock the power of Laravel's broadcasting system with Wave. Imagine that real-time server broadcasting is possible over native HTTP without any WebSockets setup. Meet the Server-sent Events 🛜 Works seamlessly with Laravel's default Redis broadcasting driver and supports Laravel Echo. Wave seamlessly integrates with Laravel's default Redis broadcasting driver, ensuring efficient real-time data transfer. Wave intelligently resumes the event stream from the last event, ensuring no crucial data... -
6
Laravel Settings
Store strongly typed application settings
This package allows you to store settings in a repository (database, Redis, ...) and use them through an application without hassle. If you want to use these settings somewhere in your application, you can inject them, since we register them in the Laravel Container. -
7
UNIT3D Community Edition
Private Torrent Tracker Built With Laravel, Livewire and AlpineJS
.... Caching System Supporting: "apc,” "array,” "database,” "file," "memcached," and "redis" methods. Eloquent and much more. -
8
Log Viewer
Fast and beautiful Log Viewer for Laravel
Beautiful, fast, and open-source viewer for your app logs. Forget scrolling through raw log files to find the errors or debug logs you're looking for. Forget about SSH'ing onto the production server just to read the logs. Log Viewer helps you quickly and clearly see individual log entries, to search, filter, and make sense of your Laravel logs fast. It is free and easy to install. -
9
Laravel Haystack
Supercharged job chains for Laravel
Laravel Haystack provides supercharged job chains for Laravel. It comes with powerful features like delaying jobs for as long as you like, applying middleware to every job, sharing data and models between jobs and even chunking jobs. Laravel Haystack supports every queue connection/worker out of the box. (Database, Redis/Horizon, SQS). It's great if you need to queue thousands of jobs in a chain or if you are looking for features that the original Bus chain doesn't provide. If you need to make... -
We design our technology to make workforce management easier. APS offers core HR, payroll, benefits administration, attendance, recruiting, employee onboarding, and more.
-
10
Crawlab
Distributed web crawler admin platform for spiders management
Golang-based distributed web crawler management platform, supporting various languages including Python, NodeJS, Go, Java, PHP and various web crawler frameworks including Scrapy, Puppeteer, Selenium. Please use docker-compose to one-click to start up. By doing so, you don't even have to configure MongoDB database. The frontend app interacts with the master node, which communicates with other components such as MongoDB, SeaweedFS and worker nodes. Master node and worker nodes communicate... -
11
Laravel Horizon
Dashboard and code-driven configuration for Laravel queues
Horizon provides a beautiful dashboard and code-driven configuration for your Laravel-powered Redis queues. Horizon allows you to easily monitor key metrics of your queue system such as job throughput, runtime, and job failures. All of your worker configuration is stored in a single, simple configuration file, allowing your configuration to stay in source control where your entire team can collaborate. When using Horizon, all of your queue worker configuration is stored in a single, simple... -
12
Mix PHP
PHP CLI mode development framework, supports Swoole, WorkerMan, etc.
.../database and mix/redis in any environment; you can use the native code of mix/grpc to write gRPC; all modules can be combined as randomly as building blocks. PHP gRPC library based on Swoole co-process, including protoc code generator, server, customer end. Monitor changes in your Swoole program files and automatically restart the server-applicable to development. -
13
Workerman
An asynchronous event driven PHP socket framework
... components such as asynchronous Mysql, asynchronous Redis, asynchronous Http, MQTT Internet of Things client, and asynchronous message queue. Based on the high-performance Epoll event network library, a single machine can support millions of concurrent connections, with a long connection throughput of up to 36W/S. Objects such as PHP database can be resident in memory, reducing analysis and compilation and network overhead. -
14
Laravel Visits
Laravel Visits is a counter that can be attached to any model
Laravel Visits is a counter that can be attached to any model to track its visits with useful features like IP protection and lists caching. -
15
Clockwork
PHP dev tools in your browser - server-side component
Clockwork is a development tool for PHP available right in your browser. Clockwork gives you an insight into your application runtime - including request data, performance metrics, log entries, database queries, cache queries, redis commands, dispatched events, queued jobs, rendered views, and more - for HTTP requests, commands, queue jobs, and tests. -
16
Model Caching for Laravel
Eloquent model-caching made easy.
... requirements. For best performance, a taggable cache provider is recommended (redis, memcached). While this is optional, using a non-taggable cache provider will mean that the entire cache is cleared each time a model is created, saved, updated, or deleted. Keeping keys separate for multiple database connections is automatically handled. This is especially important for multi-tenant applications and of course, any application using multiple database connections. -
17
Tenancy for Laravel
Automatic multi-tenancy for Laravel. No code changes needed
... are switched, caches are separated, filesystems are prefixed, etc. Out of the box, the package makes the following things tenant-aware: databases, caches, filesystems, queues, redis stores. This means that if you've already written your app and are looking to make it multi-tenant, you don't have to change anything. -
18
EasyZSwoole
swoole, easyswoole, swoole framework
EasySwoole is a distributed swoole framework with a permanent memory. It is born specifically for API and supports the simultaneous monitoring of HTTP, WebSocket, self-defined TCP, UDP protocol, and has rich components, such as collaboration Connect Pool, TP style co-process ORM, co-process microcredit SDK, co-process Kafka client, co-process ElasticSearch client, co-process Consul client, co-process Redis client, co-process Apollo client, co-process NSQ client, co-process self-definition queue... -
19
Codeception
Full-stack testing PHP framework
... be executed inside a PHP framework. This way web applications can be executed without web servers to run faster and access application internals. Symfony, Laravel, Zend Framework, Yii, Phalcon are supported. Connect to various data sources MySQL, PostgreSQL, MongoDB, Redis, Memcache to use their data inside tests. Take snapshots to compare data changes with previous runs. Codeception is built on top of PHPUnit and is able to execute its tests. -
20
Doctrine Cache
Doctrine Cache component
Cache component extracted from the Doctrine Common project. PHP Doctrine Cache library is a popular cache implementation that supports many different drivers such as redis, memcache, apc, mongodb and others. Doctrine Cache is a library that provides an interface for caching data. PHP Doctrine Cache library is a popular cache implementation that supports many different drivers such as redis, memcache, apc, mongodb and others. Doctrine ships with several common drivers that you can easily use... -
21
WinNMP - Windows Nginx MySql Php 8 stack
Fast & stable Nginx MariaDB Redis Php 8 development stack for Windows
WinNMP - Nginx MariaDB Redis Php 8 development stack for Windows A lightweight, fast and stable server stack for developing php mysql applications on windows, based on the excellent webserver Nginx. A lighter alternative to XAMPP and WAMP. Also known as WTServer and wt-nmp Current Package contains the latest stable versions of: - Nginx web server - MariaDB 10 database server, mysql replacement (32/64bit) - MongoDB 4 document-based database (64bit) - Redis Cache/NoSql, memcached alternative... -
22
cipi
Install and manage your server like a pro
Cipi is a Laravel-based cloud server control panel that supports Digital Ocean, AWS, Linode, Azure, Vultr, Google Cloud, and other VPS. It comes with nginx, Mysql, multi PHP-FPM versions, multi-users, Supervisor, Composer, npm, free Let's Encrypt certificates, Git deployment, fail2ban, Redis, API, and with a simple graphical interface useful to manage Laravel, Codeigniter, Symfony, WordPress or other PHP sites. Easy install: set up one or more servers with a click in less than ten minutes... -
23
Proxy yxorP
Proxy 🦄 .yxorP [v2.1] Plug & Play Stateful SAAS(y), Multi-tenancy
... and modified accordingly. Additionally, the website content can be optionally spun using the article spinning engine that is already embedded into the application. After the website has been modified the result is then stored for a predefined time inside a custom-built, flat-file cache system architectured to be 500x faster than memory-based cache systems such as Memcache and Redis. This is accomplished by bypassing the serialisation and deserialization processes, which resulted a significantly faster -
24
Swoft
PHP Microservice full Coroutine framework
Swoft is a PHP microservices coroutine framework based on the Swoole extension. Like Go, Swoft has a built-in coroutine web server and a common coroutine client and is resident in memory, independent of traditional PHP-FPM. There are similar Go language operations, similar to the Spring Cloud framework flexible annotations, powerful global dependency injection container, comprehensive service governance, flexible and powerful AOP, standard PSR specification implementation, and so on. Through... -
25
Soma-direct
System Omnichannel Marketing Analysis
Soma - System Omnichannel Marketing Analysis is an open-source solution for simplifying the processes of analyzing and predicting consumer behavior. With Soma, you can combine data from multiple systems and channels in the profile joining process. Interactions and behaviors registered as a part of a unique user create and show what a Customer Journey looks like. The data is subjected to an analysis process which enables the examination of the significance of individual touchpoints for the...