Search Results for "scrapy-redis" - Page 5
Sort By:
Showing 217 open source projects for "scrapy-redis"
View related business solutions-
With the world of work changed forever, it’s essential to manage your workplace and assets together to effectively create a high-performing environment. The Eptura experience combines the power of workplace management software with asset management, enabling you to effectively operate your building and facilitate hybrid work.
-
Don’t let unpaid invoices limit your business’s growth. EBizCharge plugs directly into the tools your business already uses to speed up payment collection.
-
1
Ccache
A fast compiler cache
.... using Nginx or Google Cloud Storage), Redis or local filesystem, optionally sharding data onto a server cluster. Supports fast "direct" and "depend" modes that don't rely on using the preprocessor. Supports compression using Zstandard. Checksums cache content using XXH3 to detect data corruption. Keeps statistics on hits/misses. Automatic cache size management. Easy installation. -
2
Cryptocurrency Exchange Feed Handler
Cryptocurrency Exchange Websocket data feed handler
Handles multiple cryptocurrency exchange data feeds and returns normalized and standardized results to client registered callbacks for events like trades, book updates, ticker updates, etc. Utilizes WebSockets when possible, but can also poll data via REST endpoints if a WebSocket is not provided. Create a FeedHandler object and add subscriptions. For the various data channels that an exchange supports, you can supply callbacks for data events, or use provided backends to handle the data for... -
3
OpsManage
Automated operation and maintenance platform
..., Python3.6 + HTML + JScripts. Front-end web framework, Bootstrap. Backend Web Framework, Django. Backend Task Framework, Celery + Redis. Programming language is Python 3.6. Operating System is CentOS 6+. Ansible version 2.6+. Deployment platform and node server Rsync 3+. -
4
Centrifugo
Scalable real-time messaging server in a language-agnostic way
Centrifugo is language-agnostic. It's a standalone server with a simple API that integrates well with an application written in any programming language. No need to change an existing application architecture to introduce real-time features. Just add Centrifugo nearby and let it deal with persistent connections. Centrifugo is built in Go language with some smart optimizations inside. It has good performance – see a description of a test stand with one million WebSocket connections and 30... -
Exact Payments delivers easy-to-integrate embedded payment solutions enabling you to rapidly onboard merchants, instantly activate a variety of payment methods and accelerate your revenue — delivering an end-to-end payment processing platform for SaaS businesses.
-
5
Machinery
Machinery is an asynchronous task queue/job queue
Machinery is an asynchronous task queue/job queue based on distributed message passing. Please be advised that V2 is work in progress and breaking changes can and will happen until it is ready. You can use the current V2 in order to avoid having to import all dependencies for brokers and backends you are not using. Instead of factory, you will need to inject broker and backend objects to the server constructor. In order to consume tasks, you need to have one or more workers running. All you... -
6
thumbor
An open-source photo thumbnail service by globo.com
... the best image crop possible. Everytime a face is detected, it will crop the image around it, making sure the most important parts of the picture are preserved. Thumbor allows users to store and load images from anywhere needed. It's really simple to implement a new loader or storage. It comes packaged with file, http, redis and mongo implementations for loaders and storages. Just pick what makes sense for you or implement your own. -
7
Redis for Windows
Native port of Redis for Windows
Native port of Redis for Windows. Redis is an in-memory database that persists on disk. The data model is key-value, but many different kind of values are supported, Strings, Lists, Sets, Sorted Sets, Hashes, Streams, HyperLogLogs. This repository contains an unofficial port of Redis to Windows. At the moment win-4.0.14 branch provides a stable port of Redis 4.0.14 for Windows x64 and win-5.0 branch provides a stable port of Redis 5.0.14 for Windows x64, both merged with archived port of win... -
8
Serf
Service orchestration and management tool
Serf is a decentralized solution for service discovery and orchestration that is lightweight, highly available, and fault tolerant. Serf runs on Linux, Mac OS X, and Windows. An efficient and lightweight gossip protocol is used to communicate with other nodes. Serf can detect node failures and notify the rest of the cluster. An event system is built on top of Serf, letting you use Serf's gossip protocol to propagate events such as deploys, configuration changes, etc. Serf is completely... -
9
Redix
A very simple pure key => value storage system that speaks Redis
redix is a very simple key => value storage engine that speaks redis and even more simpler and flexible. redis is very simple, sometimes we abuse it, so I decided to build a pure key-value storage system that introduces the core utilities for building any data structure you want based on the key => value model that is because I think that everything could be modeled easily using that model, so I decided to not to follow redis and all of its commands, you won’t find lpush, hset, sadd, … etc you... -
Track all your service data in one easy-to-use system, enabling your team to move faster and generate more revenue for your bottom line.
-
10
koa-cash
HTTP response caching for Koa. Supports Redis, in-memory store, etc.
HTTP response caching for Koa. Supports Redis, in-memory store, and more. -
11
Walrus
Lightweight Python utilities for working with Redis
The purpose of walrus is to make working with Redis in Python a little easier. Rather than ask you to learn a new library, walrus subclasses and extends the popular redis-py client, allowing it to be used as a drop-in replacement. In addition to all the features in redis-py, walrus adds support for some newer commands, including full support for streams and consumer groups. Persistent structures implemented on top of Hashes. Supports secondary indexes to allow filtering on equality, inequality... -
12
Doctrine Cache
Doctrine Cache component
Cache component extracted from the Doctrine Common project. PHP Doctrine Cache library is a popular cache implementation that supports many different drivers such as redis, memcache, apc, mongodb and others. Doctrine Cache is a library that provides an interface for caching data. PHP Doctrine Cache library is a popular cache implementation that supports many different drivers such as redis, memcache, apc, mongodb and others. Doctrine ships with several common drivers that you can easily use... -
13
Lad
Lad is the best Node.js framework
Lad is the best Node.js framework. Made by a former Express TC and Koa team member. Lad boasts dozens of features and is extremely configurable. These microservices are preconfigured for security, performance, and graceful reloading. Redis, sessions, flash toast, and modal SweetAlert2 messages (uses ioredis which has support for Cluster, Sentinel, and more). Koa-based web app and API servers. Pagination built-in (using ctx-paginate). RESTful API with BasicAuth and versioning. Automated job... -
14
Revel
A high productivity, full-stack web framework for the Go language
Edit, save, and refresh. Revel compiles your code and templates for you, so you don't miss a beat. Code doesn't compile? It gives you a helpful description. Run-time code panic? Revel has you covered. Revel provides routing, parameter parsing, validation, session/flash, templating, caching, job running, a testing framework, and even internationalization. Revel is built around composable middleware called filters, which implement nearly all request-processing functionality. Developers have... -
15
WinNMP - Windows Nginx MySql Php 8 stack
Fast & stable Nginx MariaDB Redis Php 8 development stack for Windows
WinNMP - Nginx MariaDB Redis Php 8 development stack for Windows A lightweight, fast and stable server stack for developing php mysql applications on windows, based on the excellent webserver Nginx. A lighter alternative to XAMPP and WAMP. Also known as WTServer and wt-nmp Current Package contains the latest stable versions of: - Nginx web server - MariaDB 10 database server, mysql replacement (32/64bit) - MongoDB 4 document-based database (64bit) - Redis Cache/NoSql, memcached... -
16
Rich Address Downloader
Rich Cryptocurrency Wallet Address Downloader (Auto Update) v1.0.3
Rich Cryptocurrency Wallet Address Download with RAD 1.0.3 (Auto Update) All Latest Bitcoin Wallet , Latest All Ethereum Address Wallet and Tron , Dash , Dogecoin , Litecoin on Rich Address Downloader (RAD) -
17
emqx
The Most Scalable MQTT Broker for IoT
EMQX is the world's most scalable and reliable MQTT Broker designed by EMQ. It supports 100M concurrent IoT device connections per cluster while maintaining extremely high throughput and sub-millisecond latency. EMQX boasts more than 20,000 global users from over 50 countries, connecting more than 100M IoT devices worldwide, and is trusted by over 300 customers in mission-critical IoT scenarios, including well-known brands like HPE, VMware, Verifone, SAIC Volkswagen and Ericsson. Flex... -
18
gawk libraries for XML, PostgreSQL,...
Dynamically loaded extension libraries for GNU AWK
... contributions. Recent additions include haru, redis, and select for I/O multiplexing. -
19
jookdb
Free Multi-platform database tool
JookDB is a database development tool that allows you to simultaneously connect to MySQL, MariaDB, Oracle, PostgreSQL, SQLite, MongoDB,Redis, DM, OceanBase, TiDB and SQLServer databases from a single application. You can quickly and easily build, manage and maintain your databases. -
20
aaPanel
aaPanel, a simple but powerful hosting control panel
aaPanel provides the one-click function such as one-click install LNMP/LAMP developing environment and software. Our main goal is helping users to save the time of deploying, thus users just focus on their own project that is fine. -
21
Catbird Linux
Linux for content creation, web scraping, coding, and data analysis.
Catbird Linux is an operating system built for media creation, web scraping, and software coding. It is the daily driver you want for retrieving data, making videos or podcasts, and making software tools to automate the repetitive tasks. It is ready for work in Python, Lua, and Go languages, with numerous packages for web scraping or downloading data via API calls. Using Catbird Linux, it is possible to accomplish in depth stock market analysis, track weather trends, follow social media... -
22
1. Overview REMON stands for Redis Multi-instance Monitoring and is software that monitors the status of the Redis database and supports convenience functions so that users can see at a glance whether Redis instances are operating normally. 2. Features 1) Matrix view: You can monitor Redis instances by grouping them. 2) Minimize CPU load: The Agent's CPU usage rate is less than 2%, causing very little load. 3) Threshold notification and quick confirmation: You can monitor important...
-
23
Pottery
Redis for humans
Redis is awesome, but Redis commands are not always intuitive. Pottery is a Pythonic way to access Redis. If you know how to use Python dicts, then you already know how to use Pottery. Pottery is useful for accessing Redis more easily, and also for implementing microservice resilience patterns, and it has been battle-tested in production at scale. -
24
FACIL.IO
Your high performance web application C framework
facil.io is an evented Network library written in C. facil.io provides high performance TCP/IP network services by using an evented design that was tested to provide an easy solution to the C10K problem. facil.io includes a mini-framework for Web Applications, with a fast HTTP / WebSocket server, integrated Pub/Sub, optional Redis connectivity, easy JSON handling, Mustache template rendering and more nifty tidbits. facil.io powers the HTTP/Websockets Ruby Iodine server and it can easily power... -
25
KumoMTA
The first Open-Source high-performance MTA for high-volume senders
KumoMTA is an Open-Source, enterprise-grade email message transfer agent (MTA) software for sending high-volume, business-critical emails. KumoMTA is typically chosen by high-volume email users looking to replace PowerMTA, Momentum, or traditional Open Source MTAs. KumoMTA offers high-performance message relay to the tune of millions of messages per hour per server, combined with extreme flexibility and configurability through its use of a Lua scripting engine for configuration and...