Search Results for "scrapy-redis" - Page 4
Sort By:
Showing 105 open source projects for "scrapy-redis"
View related business solutions-
HubSpot is an AI-powered customer platform with all the software, integrations, and resources you need to connect your marketing, sales, and customer service. HubSpot's connected platform enables you to grow your business faster by focusing on what matters most: your customers.
-
Whether natural disaster, cyberattack, or plain-old human error, data can disappear in the blink of an eye. ConnectWise BCDR (formerly Recover) delivers reliable and secure backup and disaster recovery backed by powerful automation and a 24/7 NOC to get your clients back to work in minutes, not days.
-
1
nrg
A batteries-included web framework for Node.js
A batteries-included Node.js web framework. -
2
graphql-subscriptions
A small module that implements GraphQL subscriptions for Node.js
GraphQL subscriptions is a simple npm package that lets you wire up GraphQL with a pubsub system (like Redis) to implement subscriptions in GraphQL. You can use it with any GraphQL client and server (not only Apollo). To begin with GraphQL subscriptions, start by defining a GraphQL Subscription type in your schema. Next, add the Subscription type to your schema definition. Now, let's create a simple PubSub instance - it is a simple pubsub implementation, based on EventEmitter. Alternative... -
3
Proxy yxorP
Proxy 🦄 .yxorP [v2.1] Plug & Play Stateful SAAS(y), Multi-tenancy
... and modified accordingly. Additionally, the website content can be optionally spun using the article spinning engine that is already embedded into the application. After the website has been modified the result is then stored for a predefined time inside a custom-built, flat-file cache system architectured to be 500x faster than memory-based cache systems such as Memcache and Redis. This is accomplished by bypassing the serialisation and deserialization processes, which resulted a significantly faster -
4
koa-simple-ratelimit
Simple rate limiter for Koa.js v2 web framework
Rate limiter middleware for koa v2. Differs from koa-rate limit by not depending on rate limiter and using Redis ttl (time to live) to handle expiration time remaining. This creates only one entry in Redis instead of the three that node-ratelimiter does. -
BigQuery Studio provides a single, unified interface for all data practitioners of various coding skills to simplify analytics workflows from data ingestion and preparation to data exploration and visualization to ML model creation and use. It also allows you to use simple SQL to access Vertex AI foundational models directly inside BigQuery for text processing tasks, such as sentiment analysis, entity extraction, and many more without having to deal with specialized models.
-
5
Swoft
PHP Microservice full Coroutine framework
Swoft is a PHP microservices coroutine framework based on the Swoole extension. Like Go, Swoft has a built-in coroutine web server and a common coroutine client and is resident in memory, independent of traditional PHP-FPM. There are similar Go language operations, similar to the Spring Cloud framework flexible annotations, powerful global dependency injection container, comprehensive service governance, flexible and powerful AOP, standard PSR specification implementation, and so on. Through... -
6
CoolStore Web Application
A full-stack .NET microservices build on Dapr and Tye
CoolStore Website is a containerized polyglot microservices application consisting of services based on .NET Core, NodeJS, and more running on Service Mesh. It demonstrates how to wire up small microservices and build up a larger application using microservice architectural principles. It's mainly building for the .NET ecosystem with a lot of popular libraries and toolkits that have been used by the .NET community for a long time. Additionally, it uses and experiments with new components and... -
7
N2O
Distributed WebSocket Application Server ISO 20922
N2O is an embeddable message protocol loop library for WebSocket, HTTP, MQTT and TCP servers. It provides basic features, such as process management, virtual nodes ring for request processing, sessions, frame encoding, and unified API for external mq and caching services. -
8
Pandora.js
A manageable, measurable and traceable Node.js application manager
... failures, aims to enhance system resilience. Do trouble shooting by remote debugging. The data can be achieved via RESTFul API or local file system. It is super easy to integrate it with your monitoring system. Be able to trace the whole execution stack, and inspect applications at runtime. Support tons of 3rd party middleware, MySQL, redis, etc. Compatible with Open-Tracing standard. -
9
cache-pug-templates
Cache Pug templates for Lad/Koa/Express/Connect with Redis
Cache Pug templates for Lad/Koa/Express/Connect. -
From improving customer experience through seamless sign-on to making MFA as easy as a click of a button – your login box must find the right balance between user convenience, privacy and security.
-
10
koa-redis
Redis storage for Koa session middleware/cache with Sentinel support
Redis storage for Koa session middleware/cache with Sentinel and Cluster support. koa-redis works with koa-generic-session (a generic session middleware for koa). -
11
SpaceX REST API
Open Source REST API for SpaceX launch, rocket, core, capsule, etc.
... return 401 without a valid key. The API makes use of response caching via Redis for all GET requests, and POST requests on /query endpoints. -
12
Overlord
Providing automated and highly available caching service solutions
Overlord is the proxy and cluster management function of Bilibili based on memcache and redis &cluster written in Go language, and is committed to providing automated and highly available caching service solutions. It mainly includes the following components. A lightweight and highly available cache proxy module that supports memcache and redis proxies, which is equivalent to twemproxy. The difference is that it supports redis-cluster and can disguise itself as a cluster mode. Including... -
13
Go-Guerrilla SMTP Daemon
Mini SMTP server written in golang
A lightweight SMTP server written in Go, made for receiving large volumes of mail. To be used as a package in your Go project, or as a stand-alone daemon by running the "guerrillad" binary. Supports MySQL and Redis out-of-the-box, with many other vendor provided processors, such as MailDir and even FastCGI! It's an SMTP server written in Go, for the purpose of receiving large volumes of email. It started as a project for GuerrillaMail.com which processes millions of emails every day, and needed... -
14
minikube php_psql redis
The environment using Minikube to show a simple PHP page with PostgreS
minikube_php_psql_redis The environment using Minikube to show a simple PHP page with PostgreSQL and Redis. Tested on MacOsx with: Docker version 18.09.1, build 4c52b90 Minikube version: v0.33.1 Client/Server Version: version.Info{Major:"1", Minor:"13", GitVersion:"v1.13.2" Redis not tested yet! -
15
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
Django Dynamic Scraper (DDS) is an app for Django build on top of the scraping framework Scrapy. While preserving many of the features of Scrapy it lets you dynamically create and manage spiders via the Django admin interface. With Django Dynamic Scraper (DDS) you can define your Scrapy scrapers dynamically via the Django admin interface and save your scraped items in the database you defined for your Django project. Since it simplifies things DDS is not usable for all kinds of scrapers... -
16
CacheManager
CacheManager is an open source caching abstraction layer for .NET
CacheManager is an open source caching framework for .NET written in C# and is available via NuGet. It supports various cache providers and implements many advanced features. A simple but very efficient implementation. This handle is faster than any other in most scenarios and works cross-platform. Two implementations are available, based on System.Runtime.Caching and based on the new Microsoft.Extensions.Caching.Memory package. Redis can be used as an extremely fast and reliable out-of-process... -
17
confd
Manage local application configuration files using templates from etcd
confd is a lightweight configuration management tool focused on keeping local configuration files up-to-date using data stored in etcd, consul, dynamodb, redis, vault, zookeeper, aws ssm parameter store or env vars and processing template resources. confd is also focused on reloading applications to pick up new config file changes. Go 1.10 is required to build confd, which uses the new vendor directory. You should have a working etcd, or consul server up and running and the ability to add new... -
18
Codis
Proxy based Redis cluster solution supporting pipeline
Codis is a proxy-based high-performance Redis cluster solution written in Go. It is production-ready and widely used at wandoujia.com and many companies. You can see Codis Releases for latest and most stable releases. GUI website dashboard & admin tools. Supports most of Redis commands. Fully compatible with Twemproxy. Proxies can register on zk/etcd, clients can avoid dead proxies, see "High Availability" section. "Resharding" means migrating the data in one slot from one redis server... -
19
apicache
Simple API-caching middleware for Express/Node
Simple API-caching middleware for Express/Node. A simple API response caching middleware for Express/Node using plain-English durations. Supports Redis or a built-in memory engine with auto-clearing. Because route-caching of simple data/responses should also be simple. Sometimes you need custom keys (e.g. save routes per session, or per method). We've made it easy! All req/res attributes used in the generation of the key must have been set previously (upstream). The entire route logic block... -
20
PHP Framework - Smart.Framework
The next-generation PHP Framework Middleware + MVC
Smart.Framework - A High Performance PHP / Javascript Framework for Web Projects Clean Code Full Decoupled Libraries Independent Packages (based on plugins) Great Architecture (a hybrid between Multi-Tier and Middleware, combined with clean code separation as MVC). So, it is a very light and fast PHP / Javascript web framework. The paradox is that it have more built-in features than the well-known frameworks like Zend Framework 2 or Symfony 2 but is 2x ... 9x faster in the terms of... -
21
crVCL PHP Framework
Rapid Application Development Framework for PHP
crVCL PHP Framework is based on PHP 5.4, Javascript 1.4 and CSS 2.1 (or higher). It provide classes and function for develop easy and fast web applications/webpages with graphical components. It give you more comfort in developing web applications with high usability. Rapid Application Development for PHP crVCL is inspired by JEDI VCL and Java Spring If you like the Project, donate it http://goo.gl/PYyiot for more visit the Website or take a look at the readme.txt More... -
22
waterline
ORM for Node.js with support for mysql, mongo, postgres, mssql
It provides a uniform API for accessing stuff from different kinds of databases, protocols, and 3rd party APIs. That means you write the same code to get and store things like users, whether they live in Redis, mySQL, LDAP, MongoDB, or Postgres. Waterline strives to inherit the best parts of ORMs like ActiveRecord, Hibernate, and Mongoose, but with a fresh perspective and emphasis on modularity, testability, and consistency across adapters. Sails comes installed with a powerful ORM/ODM called... -
23
chat.io
A Real Time Chat Application built using Node.js, Express, Mongoose
A Real-Time Chat Application built using Node.js, Express, Mongoose, Socket.io, Passport, & Redis. The configurations on production will be assigned from Environment Variables on Heroku, while the development configurations reside inside app/config/config.json file. You need to create a database on MongoLab, then create a database user, get the MongoDB URI, and assign it to dbURI. You need to register a new application on both Facebook and Twitter to get your tokens by which users can grant... -
24
NCache非阻塞式缓存
非阻塞式缓存框架
缓存是服务器程序中经常用到的技术，使用缓存可以大大降低服务器的压力。目前常见的缓存工具都很好地解决了生命周期、存储、命中率等关键算法，但是绝大多数的缓存框架对于数据更新都是阻塞式的，即当缓存过期时会等待应用程序重新获取值，用户在使用系统的过程中将产生顿挫感。 NCache建立了一套抽象的非阻塞式缓存模型与API， 使用NCache仅需在首次加载数据时停顿，此后的更新都将在后台线程完成。 使用NCache至少具有以下两个好处： 1.用户具有平滑的页面体验 2.访问压力将在应用堆积并适当溢出，缓解了对数据服务的集中请求压力 -
25
RedisClient
Java Redis Client GUI Tool
This is a redis client GUI tool written based on Java SWT and Jedis. It's my objective to build the most convenient redis client GUI tool in the world. In the first place, it will facilitate in editing redis data, such as: add, update, delete, search, cut, copy, paste etc.