Search Results for "scrapy-redis" - Page 7
Sort By:
Showing 214 open source projects for "scrapy-redis"
View related business solutions-
From improving customer experience through seamless sign-on to making MFA as easy as a click of a button – your login box must find the right balance between user convenience, privacy and security.
-
Red Hat Enterprise Linux (RHEL) on Microsoft Azure provides a secure, reliable, and flexible foundation for your cloud infrastructure. Red Hat Enterprise Linux on Microsoft Azure is ideal for enterprises seeking to enhance their cloud environment with seamless integration, consistent performance, and comprehensive support.
-
1
FreeRADIUS for Windows
Windows Native port of freeRADIUS Server
First and only Windows native port of freeRADIUS Server. It supports many features such as: * EAP Methods * MySQL, PostgreSQL, MSSQL plus ODBC * LDAP, Kerberos, Redis * NTLM * Python, Perl Please, visit http://www.winradius.eu/ for more info. -
2
Ledge
An RFC compliant and ESI capable HTTP cache for Nginx / OpenResty
An RFC-compliant and ESI-capable HTTP cache for Nginx / OpenResty, backed by Redis. Ledge can be utilized as a fast, robust, and scalable alternative to Squid / Varnish, etc, either installed standalone or integrated into an existing Nginx server or load balancer. Moreover, it is particularly suited to applications where the origin is expensive or distant, making it desirable to serve from the cache as optimistically as possible. -
3
Go-Guerrilla SMTP Daemon
Mini SMTP server written in golang
A lightweight SMTP server written in Go, made for receiving large volumes of mail. To be used as a package in your Go project, or as a stand-alone daemon by running the "guerrillad" binary. Supports MySQL and Redis out-of-the-box, with many other vendor provided processors, such as MailDir and even FastCGI! It's an SMTP server written in Go, for the purpose of receiving large volumes of email. It started as a project for GuerrillaMail.com which processes millions of emails every day, and needed... -
4
Wamp.NET
Powerful modular wamp stack
The goal of Wamp.NET is to give developers multiple environments in which to develop websites in order to match the environment (e.g. Webserver, PHP Version, Database etc.) where the websites are being hosted. Sites created in Wamp.NET are completely independent from Webserver and PHP version. You can change the assigned webserver and PHP version without affecting the vhost configuration or files and folders in the document root. If you're coming from another **mp stack where you were... -
Whether natural disaster, cyberattack, or plain-old human error, data can disappear in the blink of an eye. ConnectWise BCDR (formerly Recover) delivers reliable and secure backup and disaster recovery backed by powerful automation and a 24/7 NOC to get your clients back to work in minutes, not days.
-
5
minikube php_psql redis
The environment using Minikube to show a simple PHP page with PostgreS
minikube_php_psql_redis The environment using Minikube to show a simple PHP page with PostgreSQL and Redis. Tested on MacOsx with: Docker version 18.09.1, build 4c52b90 Minikube version: v0.33.1 Client/Server Version: version.Info{Major:"1", Minor:"13", GitVersion:"v1.13.2" Redis not tested yet! -
6
aredis
An Asynchronous Pipelined Java client for Redis
AREDIS (Asynchronous REDIS java client) is a java client for the Redis Cache server (http://redis.io) designed for performance and efficiency. It has only one connection to each server and uses pipelining for performance rather than connection pooling. It uses the Java 7 NIO based Asynchronous channel API for socket communication to the Redis server. Important features are Data Handler API for storing Objects, OPTI_JAVA_HANDLER for efficient storage of Java Objects, built-in gzip... -
7
UnQLite
An Embedded NoSQL, Transactional Database Engine
UnQLite is an in-process software library that implements a self-contained, serverless, zero-configuration, transactional NoSQL database engine. UnQLite is a document store database similar to MongoDB, Redis, CouchDB, etc. as well as a standard Key/Value store similar to BerkeleyDB, LevelDB, etc. UnQLite is an embedded NoSQL (Key/Value store and Document-store) database engine. Unlike most other NoSQL databases, UnQLite does not have a separate server process. UnQLite reads and writes directly... -
8
FastoRedis
Cross-platform open source Redis DB management tool
FastoRedis (fork of FastoNoSQL) — is a cross-platform open source Redis management tool (i.e. Admin GUI). It put the same engine that powers Redis's redis-cli shell. Everything you can write in redis-cli shell — you can write in FastoRedis! Our program works on the most amount of Linux systems, also on Windows, Mac OS X, FreeBSD and Android platforms, on desktops and embedded devices. -
9
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
Django Dynamic Scraper (DDS) is an app for Django build on top of the scraping framework Scrapy. While preserving many of the features of Scrapy it lets you dynamically create and manage spiders via the Django admin interface. With Django Dynamic Scraper (DDS) you can define your Scrapy scrapers dynamically via the Django admin interface and save your scraped items in the database you defined for your Django project. Since it simplifies things DDS is not usable for all kinds of scrapers... -
Give your HR team the tools they need to streamline administrative tasks, support employees, and make informed decisions with the OrangeHRM free and open source HR software.
-
10
Laragon
Powerful tool for modern apps: Django, Rails, Laravel, Node, Go, Java
Laragon makes coding more fun and easier. Instant setup - extremely fast, lightweight, intuitive, and powerful universal development enviroment for creating modern apps with many stacks: Ruby on Rails, Laravel, Django, Flask, MEAN and Spring Boot. Portable, reliable and Zero operation on MySQL, PostgreSQL, MongoDB, Memcached, Redis, PHP, Ruby, Python, Node.js and Java. -
11
CacheManager
CacheManager is an open source caching abstraction layer for .NET
CacheManager is an open source caching framework for .NET written in C# and is available via NuGet. It supports various cache providers and implements many advanced features. A simple but very efficient implementation. This handle is faster than any other in most scenarios and works cross-platform. Two implementations are available, based on System.Runtime.Caching and based on the new Microsoft.Extensions.Caching.Memory package. Redis can be used as an extremely fast and reliable out-of-process... -
12
FastoNoSQL
FastoNoSQL it is GUI platform for NoSQL databases.
Gui managment admin tool for: Redis Memcached SSDB LevelDB RocksDB UnQLite LMDB UpscaleDB ForestDB -
13
one advanced C lib for UNIX and WINDOWS
one server framework
Advanced C/C++ library(ACL) for UNIX-like OS and WIN32 OS, including sync/async/ssl iostream for net/file, thread pool, process pool, db pool, server framework, event, memory, string, array/hash/ring/list, xml and json parser, http/smtp/icmp protocol, SSL/TLS, C unit test, etc -
14
Redis Desktop Manager
:wrench: Cross-platform GUI management tool for Redis
Redis Desktop Manager is a fast, open source Redis database management application based on Qt 5. It's available for Windows, Linux and MacOS and offers an easy-to-use GUI to access your Redis DB. With Redis Desktop Manager you can perform some basic operations such as view keys as a tree, CRUD keys and execute commands via shell. It also supports SSL/TLS encryption, SSH tunnels and cloud Redis instances, such as: Amazon ElastiCache, Microsoft Azure Redis Cache and Redis Labs. -
15
Headless Chrome Crawler
Distributed crawler powered by Headless Chrome
Crawlers based on simple requests to HTML files are generally fast. However, it sometimes ends up capturing empty bodies, especially when the websites are built on such modern frontend frameworks as AngularJS, React and Vue.js. Powered by Headless Chrome, the crawler provides simple APIs to crawl dynamic websites. Support both depth-first search and breadth-first search algorithm. Save screenshots for the crawling evidence, emulate devices and user agents, priority queue for crawling... -
16
Ardb
A redis protocol compatible nosql, it support multiple storage engines
A redis protocol compatible nosql, it supports multiple storage engines as backend like Google's LevelDB, Facebook's RocksDB, OpenLDAP's LMDB, PerconaFT, WiredTiger, ForestDB. Full redis-protocol compatibility. Most redis commands are supported, and a few new commands. Ardb commands VS Redis Commands. Multi storage engines supported. RocksDB, LevelDB, LMDB, WiredTiger, PerconaFT, ForestDB. Multi data structure types supported, String, List, Set, Sorted Set, Hash, Bitmap(String), HyperLogLog... -
17
confd
Manage local application configuration files using templates from etcd
confd is a lightweight configuration management tool focused on keeping local configuration files up-to-date using data stored in etcd, consul, dynamodb, redis, vault, zookeeper, aws ssm parameter store or env vars and processing template resources. confd is also focused on reloading applications to pick up new config file changes. Go 1.10 is required to build confd, which uses the new vendor directory. You should have a working etcd, or consul server up and running and the ability to add new... -
18
pyspider
A powerful Spider(Web Crawler) system in Python
pyspider is a powerful Spider(Web Crawler) system in Python. Components are connected by message queue. Every component, including message queue, is running in their own process/thread, and replaceable. That means, when process is slow, you can have many instances of processor and make full use of multiple CPUs, or deploy to multiple machines. This architecture makes pyspider really fast. benchmarking. Since pyspider has various components, you can just run pyspider to start a standalone and... -
19
PumpedUp
Performance monitoring and logging software for Linux and Windows.
PumpedUp gathers system performance data on a second by second basis and creates real time or static graphical web pages. It can quickly point out maximized resources on a system. It also has options for sending data to Redis / Logstash for analysis, or Nagios for alarming. PumpedUp runs an insecure web server on port 8080 by default and requires you to provide your own security for that port. You can disable this functionality by editing the PumpedUp configuration file. After... -
20
FAKE2DB
Create custom test databases that are populated with fake data
Generate fake but valid data filled databases for test purposes using most popular patterns(AFAIK). Current support is sqlite, mysql, postgresql, mongodb, redis, CouchDB. The installation through pypi retrieves 'fake-factory' as a main dependency. db argument takes 6 possible options, sqlite, mysql, postgresql, mongodb, redis, CouchDB. name argument is OPTIONAL. When it is absent fake2db will name db's randomly. host argument is OPTIONAL. Hostname to use for database connection. Not used... -
21
Codis
Proxy based Redis cluster solution supporting pipeline
Codis is a proxy-based high-performance Redis cluster solution written in Go. It is production-ready and widely used at wandoujia.com and many companies. You can see Codis Releases for latest and most stable releases. GUI website dashboard & admin tools. Supports most of Redis commands. Fully compatible with Twemproxy. Proxies can register on zk/etcd, clients can avoid dead proxies, see "High Availability" section. "Resharding" means migrating the data in one slot from one redis server... -
22
Cabot
Self-hosted, easily-deployable monitoring and alerts service
Cabot is a free, open-source, self-hosted infrastructure monitoring platform that provides some of the best features of PagerDuty, Server Density, Pingdom and Nagios without their cost and complexity. It provides a web interface that allows you to monitor services (e.g. "Stage Redis server", "Production ElasticSearch cluster") and send telephone, sms or hipchat/email alerts to your on-duty team if those services start misbehaving or go down - all without writing a line of code. Best of all, you... -
23
apicache
Simple API-caching middleware for Express/Node
Simple API-caching middleware for Express/Node. A simple API response caching middleware for Express/Node using plain-English durations. Supports Redis or a built-in memory engine with auto-clearing. Because route-caching of simple data/responses should also be simple. Sometimes you need custom keys (e.g. save routes per session, or per method). We've made it easy! All req/res attributes used in the generation of the key must have been set previously (upstream). The entire route logic block... -
24
Kue
Kue is a priority job queue backed by redis, built for node.js
Kue is a feature rich priority job queue for node.js backed by redis. A key feature of Kue is its clean user-interface for viewing and managing queued, active, failed, and completed jobs. At any point in the job's life-time you can view verbose details, including the job's arbitrary data, creation, update, failure, and completion times. Jobs may incrementally update their progress, providing vital feedback for long-running tasks. Job-specific logging allows you to see how your job's... -
25
PHP Framework - Smart.Framework
The next-generation PHP Framework Middleware + MVC
Smart.Framework - A High Performance PHP / Javascript Framework for Web Projects Clean Code Full Decoupled Libraries Independent Packages (based on plugins) Great Architecture (a hybrid between Multi-Tier and Middleware, combined with clean code separation as MVC). So, it is a very light and fast PHP / Javascript web framework. The paradox is that it have more built-in features than the well-known frameworks like Zend Framework 2 or Symfony 2 but is 2x ... 9x faster in the terms of requests...