Search Results for "scrapy-redis" - Page 2
Sort By:
Showing 217 open source projects for "scrapy-redis"
View related business solutions-
Stop messing with tools that aren’t designed to amplify volunteer programs. With VolunteerMatters, it’s a delight to manage everything in one place.
-
Evolia is a web and mobile platform that connects enterprises with 1000’s of local shift workers and offers free workforce scheduling and time and attendance solutions. Is your business on Evolia?
-
1
POCO
Cross-platform C++ libraries for building network applications
The POCO C++ Libraries are powerful cross-platform C++ libraries for building network- and internet-based applications that run on desktop, server, mobile, IoT, and embedded systems. Whether building automation systems, industrial automation, IoT platforms, air traffic management systems, enterprise IT application and infrastructure management, security and network analytics, automotive infotainment and telematics, financial or healthcare, C++ developers have been trusting the POCO C++... -
2
NodeBB
Node.js based forum software built for the modern web
A better community platform for the modern web. NodeBB is next generation forum software. It's powerful, mobile-ready and easy to use. NodeBB Forum Software is powered by Node.js and supports either Redis, MongoDB, or a PostgreSQL database. It utilizes web sockets for instant interactions and real-time notifications. NodeBB has many modern features out of the box such as social network integration and streaming discussions, while still making sure to be compatible with older browsers. From... -
3
jackal
Instant messaging server for the Extensible Messaging
jackal is a free, open-source, high-performance XMPP server that aims to be known for its stability, simple configuration and low resource consumption. Customizable, enforced SSL/TLS. Stream compression (zlib), database connectivity for storing offline messages and user settings (PostgreSQL 9.5+, BoltDB). Caching (Redis 6.2+), clustering capabilities (etcd 3.4+) Expose Prometheus metrics, cross-platform (OS X, Linux). To make it easy to install jackal via Helm in Kubernetes a chart has been... -
4
Camellia
Camellia provide easy-to-use server toolkits
Camellia was originally developed as the basic architecture for netease-yunxin's servers, all the modules are running in netease-yunxin's online env. -
YesEvents offers a comprehensive suite of services that spans the entire conference lifecycle and ensures every detail is executed with precision. Our commitment to exceptional customer service extends beyond conventional boundaries, consistently exceeding expectations and enriching both organizer and attendee experiences.
-
5
Laravel Horizon
Dashboard and code-driven configuration for Laravel queues
Horizon provides a beautiful dashboard and code-driven configuration for your Laravel-powered Redis queues. Horizon allows you to easily monitor key metrics of your queue system such as job throughput, runtime, and job failures. All of your worker configuration is stored in a single, simple configuration file, allowing your configuration to stay in source control where your entire team can collaborate. When using Horizon, all of your queue worker configuration is stored in a single, simple... -
6
Redigo
Go client for Redis
Redigo is a Go client for the Redis database. A Print-like API with support for all Redis commands. Pipelining, including pipelined transactions. Publish/Subscribe. Connection pooling. Script helper type with optimistic use of EVALSHA. Helper functions for working with command replies. The Conn interface is the primary interface for working with Redis. Applications create connections by calling the Dial, DialWithTimeout or NewConn functions. In the future, functions will be added for creating... -
7
Lada Cache
A Redis based, fully automated and scalable database cache layer
A Redis-based, fully automated, and scalable database cache layer for Laravel. -
8
Log Viewer
Fast and beautiful Log Viewer for Laravel
Beautiful, fast, and open-source viewer for your app logs. Forget scrolling through raw log files to find the errors or debug logs you're looking for. Forget about SSH'ing onto the production server just to read the logs. Log Viewer helps you quickly and clearly see individual log entries, to search, filter, and make sense of your Laravel logs fast. It is free and easy to install. -
9
ProxyPool
An Efficient ProxyPool with Getter, Tester and Server
Simple and efficient proxy pool, providing the following functions. Regularly crawl free proxy websites, easy and scalable. Use Redis to store brokers and sort broker availability. Regular testing and screening to eliminate unavailable proxies and leave available proxies. Provides a proxy API to randomly select available proxies that pass the test. The principle analysis of the proxy pool can be seen in " How to Build an Efficient Proxy Pool ". It is recommended to read it before using... -
Built for growing businesses and well-established enterprises alike, Multiview is a highly scalable and robust ERP.
-
10
NodePress
RESTful API service
RESTful API service for surmon.me blog, powered by NestJS, required MongoDB & Redis. -
11
Miniredis
Pure Go Redis server for Go unittests
Sometimes you want to test code which uses Redis, without making it a full-blown integration test. Miniredis implements (parts of) the Redis server, to be used in unittests. It enables a simple, cheap, in-memory, Redis replacement, with a real TCP interface. It saves you from using mock code, and since the redis server lives in the test process you can query for values directly, without going through the server stack. There are no dependencies on external binaries, so you can easily integrate... -
12
Django RQ
A simple app that provides django integration for RQ
A simple app that provides django integration for RQ (Redis Queue). Django integration with RQ, a Redis-based Python queuing library. Django-RQ is a simple app that allows you to configure your queues in django's settings.py and easily use them in your project. Django-RQ allows you to easily put jobs into any of the queues defined in settings.py. You can provide your own singleton Redis connection object to this function so that it will not create a new connection object for each queue... -
13
NautilusTrader
A high-performance algorithmic trading platform
NautilusTrader is an open-source, high-performance, production-grade algorithmic trading platform, provides quantitative traders with the ability to backtest portfolios of automated trading strategies on historical data with an event-driven engine, and also deploy those same strategies live, with no code changes. The platform is 'AI-first', designed to develop and deploy algorithmic trading strategies within a highly performant and robust Python native environment. This helps to address the... -
14
Openblocks
The Open Source Retool Alternative
It's cumbersome to create a single app. You had to design user interfaces, write code in multiple languages and frameworks, and understand how all of that code works together. Low-code/No-code platforms are fast to get started with but quickly become unmaintainable and inflexible. This creates more problems than it solves. Retool-like solutions are great for their simplicity and flexibility, but they can also be limited in different ways compared to frameworks like React/Vue. An all-in-one... -
15
Bifrost
Middleware for production-oriented MySQL
Heterogeneous middleware for production-oriented MySQL, MariaDB, kafka synchronization to Redis, MongoDB, ClickHouse and other services. And this Bifrost can synchronize the full amount of data to multiple targets in real time. Support MySQL, MariaDB all storage types. Interface-based dynamic and flexible configuration of different data tables and target libraries. Multiple data sources, multiple target library support. Both incremental and full data synchronization are supported. One Binlog... -
16
WAL-G
Archival and Restoration for databases in the Cloud
WAL-G is an archival restoration tool for PostgreSQL, MySQL/MariaDB, and MS SQL Server (beta for MongoDB and Redis). WAL-G is the successor of WAL-E with a number of key differences. WAL-G uses LZ4, LZMA, ZSTD, or Brotli compression, multiple processors, and non-exclusive base backups for Postgres. More information on the original design and implementation of WAL-G can be found on the Citus Data blog post "Introducing WAL-G by Citus: Faster Disaster Recovery for Postgres". A precompiled binary... -
17
Nebulex
In-memory and distributed caching toolkit for Elixir
Nebulex provides support for transparently adding caching into an existing Elixir application. Similar to Ecto, the caching abstraction allows consistent use of various caching solutions with minimal impact on the code. Nebulex cache abstraction shields developers from directly dealing with the underlying caching implementations, such as Redis, Memcached, or even other Elixir cache implementations like Cachex. Additionally, it provides totally out-of-box features such as cache usage patterns... -
18
Codeception
Full-stack testing PHP framework
... be executed inside a PHP framework. This way web applications can be executed without web servers to run faster and access application internals. Symfony, Laravel, Zend Framework, Yii, Phalcon are supported. Connect to various data sources MySQL, PostgreSQL, MongoDB, Redis, Memcache to use their data inside tests. Take snapshots to compare data changes with previous runs. Codeception is built on top of PHPUnit and is able to execute its tests. -
19
Hangfire
An easy way to perform background job processing
..., Hangfire takes the responsibility to process it with the at least once semantics. Although the default installation uses SQL Server and polling technique to fetch jobs, you can leverage MSMQ or Redis extensions to reduce the processing latency to minimum. Background method calls and their arguments are serialized and may overcome the process boundaries. Job filters allow you to add custom features to the background processing in a way similar to ASP.NET MVC action filters. -
20
ScrapydWeb
Web app for Scrapyd cluster management
Web app for Scrapyd cluster management, with support for Scrapy log analysis & visualization. Make sure that Scrapyd has been installed and started on all of your hosts. Start ScrapydWeb via command scrapydweb. (a config file would be generated for customizing settings on the first startup.) Add your Scrapyd servers, both formats of string and tuple are supported, you can attach basic auth for accessing the Scrapyd server, as well as a string for grouping or labeling. You can select any number... -
21
Valkey GLIDE
An open source Valkey client library that supports Valkey and Redis
Valkey General Language Independent Driver for the Enterprise (GLIDE), is an open-source Valkey client library. Valkey GLIDE is one of the official client libraries for Valkey, and it supports all Valkey commands. Valkey GLIDE supports Valkey 7.2 and above, and Redis open-source 6.2, 7.0 and 7.2. Application programmers use Valkey GLIDE to safely and reliably connect their applications to Valkey- and Redis OSS- compatible services. Valkey GLIDE is designed for reliability, optimized performance... -
22
Laravel Wave
Painless Laravel Broadcasting with SSE
Unlock the power of Laravel's broadcasting system with Wave. Imagine that real-time server broadcasting is possible over native HTTP without any WebSockets setup. Meet the Server-sent Events 🛜 Works seamlessly with Laravel's default Redis broadcasting driver and supports Laravel Echo. Wave seamlessly integrates with Laravel's default Redis broadcasting driver, ensuring efficient real-time data transfer. Wave intelligently resumes the event stream from the last event, ensuring no crucial data... -
23
graceful
Gracefully exit HTTP servers (Express/Koa/Fastify/etc), databases
Gracefully exit HTTP servers (Express/Koa/Fastify/etc), databases (Mongo/Mongoose), Redis clients, Bree job schedulers, and custom handlers. See the Express, Koa, Fastify, or Other code snippet examples and Instance Options. You can pass Instance Options to customize your graceful handler (e.g. if you have more than one server, or wish to close both a Redis connection and a server at the same time). -
24
rosedb
High performance NoSQL database based on bitcask
A high-performance NoSQL database based on bitcask, supports string, list, hash, set, and sorted set. rosedb is a fast, stable, and embedded NoSQL database based on bitcask, that supports a variety of data structures such as string, list, hash, set, and sorted set. Easy to embed into your own Go application. High performance, suitable for both read and write-intensive workloads. Values are not limited by RAM. It is similar to Redis but store values on disk. RoseDB is based on bitcask. -
25
EasyEngine
Command-line control panel for Nginx Server to manage WordPress sites
EasyEngine makes it greatly easy to manage nginx, a fast web-server software that consumes little memory when handling increasing volumes of concurrent users.