Search Results for "scrapy-redis" - Page 4
Sort By:
Showing 217 open source projects for "scrapy-redis"
View related business solutions-
Manage your enterprise’s compensation lifecycle and accurately recognize top performers with a digitized, integrated system. Keep employees invested and your HR team in control while preventing compensation chaos.
-
Drive amazing product experiences with quality product data.
-
1
sealos
Sealos is a production-ready Kubernetes distribution
A Cloud Operating System designed for managing cloud-native applications. Sealos['siːləs] is a cloud operating system distribution based on the Kubernetes kernel. Using the cloud like using a personal computer, reducing the cost of the cloud to 1/10 of the original. -
2
koa-better-error-handler
A better error-handler for Lad and Koa. Makes `ctx.throw` awesome
Lad is the best Node.js framework. Made by a former Express TC and Koa team member. A better error-handler for Lad and Koa. Makes ctx.throw awesome (best used with koa-404-handler) Detects common programmer mistakes by detecting errors of TypeError, SyntaxError, ReferenceError, RangeError, URIError, and EvalError and yields generic "Internal Server Error" (only applies to production mode). -
3
JobRunr
An extremely easy way to perform background processing in Java
Incredibly easy way to perform fire-and-forget, delayed, scheduled and recurring jobs inside Java applications using only Java 8 lambda's. CPU and I/O intensive, long-running and short-running jobs are supported. Persistent storage is done via either RDBMS (e.g. Postgres, MariaDB/MySQL, Oracle, SQL Server, DB2 and SQLite) or NoSQL (ElasticSearch, MongoDB and Redis). JobRunr provides a unified programming model to handle background tasks in a reliable way and runs them on shared hosting... -
4
FastTunnel
Expose a local server to the internet
FastTunnel is a high-performance cross-platform intranet penetration tool. With it, you can expose intranet services to the public network for yourself or anyone to access. Unlike other penetration tools, the FastTunnel project is committed to creating an easy-to-extensible and easy-to-maintain intranet penetration framework. You can build your own penetration application by referencing the nuget package of FastTunnel.Core, and target the business extension functions you need. -
Stop messing with tools that aren’t designed to amplify volunteer programs. With VolunteerMatters, it’s a delight to manage everything in one place.
-
5
gnet
gnet is a high-performance, lightweight, networking framework
Built in Go, gnet is ultra-fast and memory efficient based on the event-driven mechanism. It's designed to create a networking server framework for Go that performs on par with Redis and Haproxy for networking packets handling. gnet is lock-free during the entire runtime, which keeps gnet free from synchronization issues and speeds it up. gnet provides concise and easy-to-use APIs for users, it only exposes the essential APIs and takes over most of the tough work for users, minimizing... -
6
lua-resty-openidc
OpenID Connect Relying Party and OAuth 2.0 Resource Server
... is used for an Access Token, verification can happen against a pre-configured secret/key. It maintains sessions for authenticated users by leveraging lua-resty-session thus offering a configurable choice between storing the session state in a client-side browser cookie or use in of the server-side storage mechanisms shared-memory|memcache|redis. -
7
Laravel Haystack
Supercharged job chains for Laravel
Laravel Haystack provides supercharged job chains for Laravel. It comes with powerful features like delaying jobs for as long as you like, applying middleware to every job, sharing data and models between jobs and even chunking jobs. Laravel Haystack supports every queue connection/worker out of the box. (Database, Redis/Horizon, SQS). It's great if you need to queue thousands of jobs in a chain or if you are looking for features that the original Bus chain doesn't provide. If you need to make... -
8
Model Caching for Laravel
Eloquent model-caching made easy.
... requirements. For best performance, a taggable cache provider is recommended (redis, memcached). While this is optional, using a non-taggable cache provider will mean that the entire cache is cleared each time a model is created, saved, updated, or deleted. Keeping keys separate for multiple database connections is automatically handled. This is especially important for multi-tenant applications and of course, any application using multiple database connections. -
9
Tenancy for Laravel
Automatic multi-tenancy for Laravel. No code changes needed
... are switched, caches are separated, filesystems are prefixed, etc. Out of the box, the package makes the following things tenant-aware: databases, caches, filesystems, queues, redis stores. This means that if you've already written your app and are looking to make it multi-tenant, you don't have to change anything. -
Your applications are all built differently, but they all need to perform. NeoLoad simplifies and scales performance testing for everything, from APIs and microservices, to end-to-end application testing through innovative protocol and browser-based capabilities.
-
10
Stash Kubernetes
Backup your Kubernetes Stateful Applications
..., StatefulSet, ReplicaSet, ReplicationController, OpenShift DeploymentConfig etc. You can also backup stand-alone PVC with "ReadWriteMany" access mode. Back up your databases deployed in Kubernetes. Stash supports backup of MariaDB, Redis, PostgreSQL, MySQL, MongoDB, Elasticsearch and Percona XtraDB, Etcd databases. It seemingly integrates with KubeDB. It is now a recommended method to backup up KubeDB-supported databases. -
11
Routr
The future of programmable SIP servers
Lightweight sip proxy, location server, and registrar that provides a reliable and scalable SIP infrastructure for telephony carriers, communication service providers, and integrators. Routr provides all the tools required to deploy your VoIP network, including a command-line for remote server control. It can also be controlled via a RESTful API or a web-based GUI. Routr includes all tools for deploying your VoIP network. It offers remote server control via command-line, RESTful API, or a... -
12
Kubero
A free and self-hosted Heroku PaaS alternative for Kubernetes
Kubero [pronounced: Kube Hero] is a fully self-hosted Internal Developer Platform (IDP) that brings the workflows of Heroku to your Kubernetes cluster. It enables you to deploy your applications with a few clicks. It has a built-in CI/CD pipeline and supports multiple staging environments. Kubero initiates two containers: one for cloning your repository and another for building your app. Once the build is complete, Kubero will launch the final container and make it accessible via the... -
13
TreeFrog Framework
TreeFrog Framework, High-speed C++ MVC Framework for Web Applications
TreeFrog Framework is a high-speed and full-stack C++ framework for developing Web applications, which supports HTTP and WebSocket protocol. Web applications can run faster than that of scripting language because the server-side framework was written in C++/Qt. In application development, it provides an O/R mapping system and template systems on an MVC architecture, aims to achieve high productivity through the policy of convention over configuration. TreeFrog Framework is cross-platform. It... -
14
EasyZSwoole
swoole, easyswoole, swoole framework
EasySwoole is a distributed swoole framework with a permanent memory. It is born specifically for API and supports the simultaneous monitoring of HTTP, WebSocket, self-defined TCP, UDP protocol, and has rich components, such as collaboration Connect Pool, TP style co-process ORM, co-process microcredit SDK, co-process Kafka client, co-process ElasticSearch client, co-process Consul client, co-process Redis client, co-process Apollo client, co-process NSQ client, co-process self-definition queue... -
15
jCasbin
An authorization library that supports access control models
.... Besides memory and file, Casbin policy can be stored into lots of places. Currently, dozens of databases are supported, from MySQL, Postgres, Oracle to MongoDB, Redis, Cassandra, AWS S3. jCasbin is a powerful and efficient open-source access control library for Java projects. It provides support for enforcing authorization based on various access control models. -
16
requests-cache
Persistent HTTP cache for python requests
... SQLite, Redis, MongoDB, and DynamoDB; or save responses as plain JSON files, YAML, and more. Use Cache-Control and other standard HTTP headers, define your own expiration schedule, and keep your cache clutter-free with backends that natively support TTL or any combination of strategies. Works out of the box with zero config, but with a robust set of features for configuring and extending the library to suit your needs. -
17
Sogou C++ Workflow
C++ parallel computing and asynchronous networking engine
As Sogou`s C++ server engine, Sogou C++ Workflow supports almost all back-end C++ online services of Sogou, including all search services, cloud input method, online advertisements, etc., handling more than 10 billion requests every day. This is an enterprise-level programming engine in light and elegant design which can satisfy most C++ back-end development requirements. -
18
HStreamDB
HStreamDB is an open-source, cloud-native streaming database
... processing. You can use your familiar SQL to perform basic filtering and transformation operations, statistics and aggregation based on multiple kinds of time windows and even joining between multiple streams. With connectors provided, you can easily integrate HStreamDB with other external systems, such as MQTT Broker, MySQL, Redis and ElasticSearch. More connectors will be added. -
19
SCS
HTTP Session Management for Go
Automatic loading and saving of session data via middleware. Choice of 19 different server-side session stores including PostgreSQL, MySQL, MSSQL, SQLite, Redis and many others. Custom session stores are also supported. Supports multiple sessions per request, 'flash' messages, session token regeneration, idle and absolute session timeouts, and 'remember me' functionality. Easy to extend and customize. Communicate session tokens to/from clients in HTTP headers or request/response bodies. SCS... -
20
DotWeb
Simple and easy go web micro framework
... HttpServer. Support STRING/JSON/JSONP/HTML format output. Integrated Mock Capability. Support custom Context. Integrated Timeout Hook. Global HTTP Error Handling. Global log processing. Support Hijack and websocket. Built-in Cache support. Built-in Session support - supports automatic switching between active and standby redis. Built-in TLS support. Support access to third-party template engines (need to implement dotweb.Renderer interface). -
21
JuiceFS
JuiceFS is a distributed POSIX file system built on top of Redis
A POSIX, HDFS and S3 compatible distributed file system for cloud. JuiceFS is designed to bring back the gold-old memories and experience of file systems in local disks to the cloud. JuiceFS is POSIX compliant and is fully compatible with HDFS and S3. Cloud app building or migrating, file sharing cross-geo and cross-cloud has become easier than ever before. Whether it's a public cloud, private cloud, or hybrid cloud, JuiceFS is available on any cloud of your choice and delivers flexibility,... -
22
Open-IM-Server
Open source Instant Messaging Server
... and quickly, and ensure the security and privacy of business data. Open-IM relies on five open source high-performance components: ETCD, MySQL, MongoDB, Redis, and Kafka. Privatization deployment Before Open-IM-Server, please make sure that the above five components have been installed. If your server does not have the above components, you must first install Missing components. If you have the above components, it is recommended to use them directly. -
23
Casbin
An authorization library that supports access control models
.... Besides memory and file, Casbin policy can be stored into lots of places. Currently, dozens of databases are supported, from MySQL, Postgres, Oracle to MongoDB, Redis, Cassandra, AWS S3. Check the full supported list at: adapters. Casbin is implemented in Golang, Java, PHP and Node.js. All implementations share the same API and behaviors. You can learn Casbin once and use it everywhere. In Casbin, the policy storage is implemented as an adapter(aka middleware for Casbin). -
24
PHP-Casbin
An authorization library that supports access control models
.... Besides memory and file, Casbin policy can be stored into lots of places. Currently, dozens of databases are supported, from MySQL, Postgres, Oracle to MongoDB, Redis, Cassandra, AWS S3. Check the full supported list at: adapters. Casbin is implemented in Golang, Java, PHP and Node.js. All implementations share the same API and behaviors. You can learn Casbin once and use it everywhere. -
25
Exq
Job processing library for Elixir - compatible with Resque / Sidekiq
Exq is a job processing library compatible with Resque / Sidekiq for the Elixir language. Exq uses Redis as a store for background processing jobs. Exq handles concurrency, job persistence, job retries, reliable queueing and tracking so you don't have to. Jobs are persistent so they would survive across node restarts. You can use multiple Erlang nodes to process from the same pool of jobs. Exq uses a format that is Resque/Sidekiq compatible. This means you can use it to integrate with existing...