Search Results for "scrapy-redis"
Sort By:
Showing 27 open source projects for "scrapy-redis"
View related business solutions-
Google Cloud is a cloud-based service that allows you to create anything from simple websites to complex applications for businesses of all sizes.
-
Speedy Claims became the top CMS-1500 Software by providing the best customer service imaginable to our thousands of clients all over America. Medical billing isn't the kind of thing most people get excited about - it is just a tedious task you have to do. But while it will never be a fun task, it doesn't have to be as difficult or time consumimg as it is now. With Speedy Claims CMS-1500 software you can get the job done quickly and easily, allowing you to focus on the things you love about your job, like helping patients. With a simple interface, powerful features to eliminate repetitive work, and unrivaled customer support, it's simply the best HCFA 1500 software available on the market. A powerful built-in error checking helps ensure your HCFA 1500 form is complete and correctly filled out, preventing CMS-1500 claims from being denied.
-
1
ioredis
A performance-focused Redis client for Node.js
ioredis is a robust, full-featured Redis client that is used in the world's biggest online commerce company Alibaba and many other awesome companies. Full-featured. It supports Cluster, Sentinel, Streams, Pipelining and of course Lua scripting & Pub/Sub (with the support of binary messages). High performance. Delightful API. It works with Node callbacks and Native promises. Transformation of command arguments and replies. Transparent key prefixing. Abstraction for Lua scripting, allowing you... -
2
Kvrocks
NoSQL database that uses RocksDB as storage engine
Apache Kvrocks(Incubating) is a distributed key-value NoSQL database that uses RocksDB as storage engine and is compatible with Redis protocol. Kvrocks intends to decrease the cost of memory and increase the capacity while compared to Redis. The design of replication and storage was inspired by rocksplicator and blackwidow. Redis protocol, user can use redis client to visit the kvrocks. Namespace, similar to redis db but use token per namespace. Replication, async replication using binlog like... -
3
Camellia
Camellia provide easy-to-use server toolkits
Camellia was originally developed as the basic architecture for netease-yunxin's servers, all the modules are running in netease-yunxin's online env. -
4
Log Viewer
Fast and beautiful Log Viewer for Laravel
Beautiful, fast, and open-source viewer for your app logs. Forget scrolling through raw log files to find the errors or debug logs you're looking for. Forget about SSH'ing onto the production server just to read the logs. Log Viewer helps you quickly and clearly see individual log entries, to search, filter, and make sense of your Laravel logs fast. It is free and easy to install. -
Exact Payments delivers easy-to-integrate embedded payment solutions enabling you to rapidly onboard merchants, instantly activate a variety of payment methods and accelerate your revenue — delivering an end-to-end payment processing platform for SaaS businesses.
-
5
Hangfire
An easy way to perform background job processing
..., Hangfire takes the responsibility to process it with the at least once semantics. Although the default installation uses SQL Server and polling technique to fetch jobs, you can leverage MSMQ or Redis extensions to reduce the processing latency to minimum. Background method calls and their arguments are serialized and may overcome the process boundaries. Job filters allow you to add custom features to the background processing in a way similar to ASP.NET MVC action filters. -
6
Foundatio
Pluggable foundation blocks for building distributed apps
Pluggable foundation blocks for building loosely coupled distributed apps. Includes implementations in Redis, Azure, AWS, RabbitMQ and in memory (for development). When building several big cloud applications we found a lack of great solutions (that's not to say there aren't solutions out there) for many key pieces to building scalable distributed applications while keeping the development experience simple. Wanted to build against abstract interfaces so that we could easily change... -
7
sealos
Sealos is a production-ready Kubernetes distribution
A Cloud Operating System designed for managing cloud-native applications. Sealos['siːləs] is a cloud operating system distribution based on the Kubernetes kernel. Using the cloud like using a personal computer, reducing the cost of the cloud to 1/10 of the original. -
8
Stash Kubernetes
Backup your Kubernetes Stateful Applications
..., StatefulSet, ReplicaSet, ReplicationController, OpenShift DeploymentConfig etc. You can also backup stand-alone PVC with "ReadWriteMany" access mode. Back up your databases deployed in Kubernetes. Stash supports backup of MariaDB, Redis, PostgreSQL, MySQL, MongoDB, Elasticsearch and Percona XtraDB, Etcd databases. It seemingly integrates with KubeDB. It is now a recommended method to backup up KubeDB-supported databases. -
9
Sogou C++ Workflow
C++ parallel computing and asynchronous networking engine
As Sogou`s C++ server engine, Sogou C++ Workflow supports almost all back-end C++ online services of Sogou, including all search services, cloud input method, online advertisements, etc., handling more than 10 billion requests every day. This is an enterprise-level programming engine in light and elegant design which can satisfy most C++ back-end development requirements. -
This means every device on your network, and every interface on every device is automatically analyzed for performance, errors, QoS, and configuration.
-
10
HStreamDB
HStreamDB is an open-source, cloud-native streaming database
... processing. You can use your familiar SQL to perform basic filtering and transformation operations, statistics and aggregation based on multiple kinds of time windows and even joining between multiple streams. With connectors provided, you can easily integrate HStreamDB with other external systems, such as MQTT Broker, MySQL, Redis and ElasticSearch. More connectors will be added. -
11
Serf
Service orchestration and management tool
Serf is a decentralized solution for service discovery and orchestration that is lightweight, highly available, and fault tolerant. Serf runs on Linux, Mac OS X, and Windows. An efficient and lightweight gossip protocol is used to communicate with other nodes. Serf can detect node failures and notify the rest of the cluster. An event system is built on top of Serf, letting you use Serf's gossip protocol to propagate events such as deploys, configuration changes, etc. Serf is completely... -
12
Redix
A very simple pure key => value storage system that speaks Redis
redix is a very simple key => value storage engine that speaks redis and even more simpler and flexible. redis is very simple, sometimes we abuse it, so I decided to build a pure key-value storage system that introduces the core utilities for building any data structure you want based on the key => value model that is because I think that everything could be modeled easily using that model, so I decided to not to follow redis and all of its commands, you won’t find lpush, hset, sadd, … etc you... -
13
emqx
The Most Scalable MQTT Broker for IoT
EMQX is the world's most scalable and reliable MQTT Broker designed by EMQ. It supports 100M concurrent IoT device connections per cluster while maintaining extremely high throughput and sub-millisecond latency. EMQX boasts more than 20,000 global users from over 50 countries, connecting more than 100M IoT devices worldwide, and is trusted by over 300 customers in mission-critical IoT scenarios, including well-known brands like HPE, VMware, Verifone, SAIC Volkswagen and Ericsson. Flex... -
14
aaPanel
aaPanel, a simple but powerful hosting control panel
aaPanel provides the one-click function such as one-click install LNMP/LAMP developing environment and software. Our main goal is helping users to save the time of deploying, thus users just focus on their own project that is fine. -
15
KumoMTA
The first Open-Source high-performance MTA for high-volume senders
KumoMTA is an Open-Source, enterprise-grade email message transfer agent (MTA) software for sending high-volume, business-critical emails. KumoMTA is typically chosen by high-volume email users looking to replace PowerMTA, Momentum, or traditional Open Source MTAs. KumoMTA offers high-performance message relay to the tune of millions of messages per hour per server, combined with extreme flexibility and configurability through its use of a Lua scripting engine for configuration and... -
16
twemproxy
A fast, light-weight proxy for memcached and redis
twemproxy (pronounced "two-em-proxy"), aka nutcracker is a fast and lightweight proxy for memcached and redis protocol. It was built primarily to reduce the number of connections to the caching servers on the backend. This, together with protocol pipelining and sharding enables you to horizontally scale your distributed caching architecture. Fast and lightweight. Maintains persistent server connections. Keeps connection count on the backend caching servers low. Enables pipelining of requests... -
17
-
18
Dynomite
A generic dynamo implementation for different k-v storage engines
Dynomite, inspired by Dynamo whitepaper, is a thin, distributed dynamo layer for different storage engines and protocols. Currently these include Redis and Memcached. Dynomite supports multi-datacenter replication and is designed for high availability. The ultimate goal with Dynomite is to be able to implement high availability and cross-datacenter replication on storage engines that do not inherently provide that functionality. The implementation is efficient, not complex (few moving parts... -
19
Ledge
An RFC compliant and ESI capable HTTP cache for Nginx / OpenResty
An RFC-compliant and ESI-capable HTTP cache for Nginx / OpenResty, backed by Redis. Ledge can be utilized as a fast, robust, and scalable alternative to Squid / Varnish, etc, either installed standalone or integrated into an existing Nginx server or load balancer. Moreover, it is particularly suited to applications where the origin is expensive or distant, making it desirable to serve from the cache as optimistically as possible. -
20
Headless Chrome Crawler
Distributed crawler powered by Headless Chrome
Crawlers based on simple requests to HTML files are generally fast. However, it sometimes ends up capturing empty bodies, especially when the websites are built on such modern frontend frameworks as AngularJS, React and Vue.js. Powered by Headless Chrome, the crawler provides simple APIs to crawl dynamic websites. Support both depth-first search and breadth-first search algorithm. Save screenshots for the crawling evidence, emulate devices and user agents, priority queue for crawling... -
21
confd
Manage local application configuration files using templates from etcd
confd is a lightweight configuration management tool focused on keeping local configuration files up-to-date using data stored in etcd, consul, dynamodb, redis, vault, zookeeper, aws ssm parameter store or env vars and processing template resources. confd is also focused on reloading applications to pick up new config file changes. Go 1.10 is required to build confd, which uses the new vendor directory. You should have a working etcd, or consul server up and running and the ability to add new... -
22
pyspider
A powerful Spider(Web Crawler) system in Python
pyspider is a powerful Spider(Web Crawler) system in Python. Components are connected by message queue. Every component, including message queue, is running in their own process/thread, and replaceable. That means, when process is slow, you can have many instances of processor and make full use of multiple CPUs, or deploy to multiple machines. This architecture makes pyspider really fast. benchmarking. Since pyspider has various components, you can just run pyspider to start a standalone and... -
23
PumpedUp
Performance monitoring and logging software for Linux and Windows.
PumpedUp gathers system performance data on a second by second basis and creates real time or static graphical web pages. It can quickly point out maximized resources on a system. It also has options for sending data to Redis / Logstash for analysis, or Nagios for alarming. PumpedUp runs an insecure web server on port 8080 by default and requires you to provide your own security for that port. You can disable this functionality by editing the PumpedUp configuration file. After... -
24
PHP-Redis-Admin
A simple, one-file PHP based admin console and browser for Redis
A simple, one-file PHP based admin console and browser for Redis -
25
packetbeat
Open Source Application Monitoring and Packet Tracing system
Packetbeat is a distributed packet monitoring system that can be used for application performance management. Think of it like a distributed real-time Wireshark with a lot more analytics features. Packetbeat agents sniff the traffic between your application processes, parse on the fly protocols like HTTP, MySQL or REDIS and correlate the messages into transactions. For each transaction, the agents insert a JSON document into ElasticSearch where they are stored and indexed. The Kibana...