Search Results for "queueing"

Procrastinate is a powerful PostgreSQL-based task queue for Python, built to integrate seamlessly with Django and FastAPI. It allows you to schedule and execute background jobs using your existing database infrastructure, avoiding the need for additional queueing systems like Redis. Procrastinate is designed with simplicity, reliability, and observability in mind.

Delayed Job is a Ruby background-processing library designed to move long-running work out of the request cycle and into an asynchronous job queue. It was extracted from Shopify and is built around a database-backed jobs table rather than a separate queueing service. The system stores serialized Ruby objects that respond to a perform method, then workers pull and execute those jobs later. It supports priority, scheduled execution, retries, failure tracking, locking, and multiple workers across machines. Developers can enqueue explicit job objects or use send_later to delay method execution on existing objects. ...

The cplusql distributed ETL tool extracts and transforms row based data from databases and flat files for terabyte scale datawarehouse loading. RSN: beowulf job queueing and cluster fs! Every day at LookSmart, it translates 200+mm rows on 100+ nodes.