Lithops Files

Added

• [API] lithops.concurrent.futures, a stdlib-compatible executor backed by Lithops. by @JosepSampe
• [Monitoring] Redis, AWS SQS, GCP Pub/Sub and Azure Queue Storage backends. by @JosepSampe
• [Core] clean_jobs on wait(), to keep temporary data until results are read. by @JosepSampe
• [AWS Batch] instance_types for EC2/SPOT compute environments. by @bystepii
• [Multiprocessing] ThreadPool, stdlib helpers, proxy methods, acquire(timeout) and Condition.notify(n). by @JosepSampe
• [Telemetry] Prometheus and OpenTelemetry metrics from call statuses. by @JosepSampe
• [Tests] Unit test suite for all non-backend modules. by @JosepSampe

Changed

• [Core] wait() returns [], [] for empty input, reuses one thread pool, and only ends the jobs it waited on. by @JosepSampe
• [Core] get_result() cleans after the results are in; stopping an executor waits for in-flight invocations. by @JosepSampe
• [Core] A list or tuple of futures as iterdata or call_async() data is now a chain. by @JosepSampe
• [Monitoring] Pluggable backends; queues live until cleanup (RabbitMQ expires after 24h); status lines every 30s. by @JosepSampe
• [Monitoring] The job monitor stays up across map()/wait() of the same executor, so the next job is not delayed by joining and replacing it. by @JosepSampe
• [Multiprocessing] Closer stdlib API: started Manager(), default imap chunksize, expiry refresh on read. by @JosepSampe
• [Worker] POSIX pipe instead of a Manager queue; SystemExit/KeyboardInterrupt reported as the function's exception. by @JosepSampe
• [Localhost] A clean job is no longer killed on cleanup, so its runner log is kept. by @JosepSampe
• [Standalone] docker login reads the password from stdin and quotes its arguments. by @JosepSampe
• [Storage] CloudFileProxy.walk() matches os.walk on a missing path; cloud_open() rejects an unsupported mode. by @JosepSampe
• [CLI] job list, worker list, image delete and image list reject unknown flags. by @JosepSampe
• [Joblib] lithops_args applied to the batch pool; upload/download pools capped at 32 threads. by @JosepSampe
• [Packaging] Package metadata moved from setup.py / setup.cfg to pyproject.toml; python_requires raised to >=3.10, matching the tested versions. by @JosepSampe
• [Development] Linting moved from flake8 to ruff (ruff check ., line length 120); new dev extra, pre-commit hooks, .editorconfig, AGENTS.md, SECURITY.md and issue / PR templates. by @JosepSampe

Fixed

• [Core] Serialization, executor IDs, FuturesList, module inspection, chunksize=0, packaging, ports, and Ctrl+C/sys.exit(). by @JosepSampe
• [Core] wait()/clean()/get_result() no longer drop unread results, other jobs' calls, or FaaS concurrency after a failure. by @JosepSampe
• [Chaining] Lists, tuples and slices of futures recognised as a chain; extra_args fails at submit time. by @JosepSampe
• [Concurrent] shutdown() waits for an in-progress submit. by @JosepSampe
• [Job] Object listing, partitions, and head_object() without content-length. by @JosepSampe
• [Monitoring] Lost statuses, token leaks, races, nested-executor queues, oversized messages, and remote-invoker cleanup. by @JosepSampe
• [Redis] put_object, head_object, list_objects/list_keys, delete_objects, and Range reads. by @JosepSampe
• [Infinispan] list_objects, Range, head_bucket, put_object, and the mech config key. by @JosepSampe
• [Multiprocessing] Pool get()/ready()/join()/callbacks, queues, locks, lists, refcounts, and proxy errors. by @JosepSampe
• [Localhost] Job-manager races, container lifetime, runner files, and python:* images taken as interpreters. by @JosepSampe
• [Standalone] Budget keeper, log FD leak, /stop, SSH, reuse-mode queue, and python:* images. by @JosepSampe
• [Storage] delete_cloudobjects() across buckets; CloudFileProxy.listdir() default. by @JosepSampe
• [Worker] Remote invoker shutdown, unpickleable exceptions, timeout/OOM reports, macOS fork-safety, and the non-Unix pool. by @JosepSampe
• [Azure] az CLI deadlock; container-app deploy races. by @JosepSampe
• [CLI] Empty job/worker lists; lithops clean deleting other jobs' local temp. by @JosepSampe
• [Cleaner] Pid-file races and unreadable requests. by @JosepSampe
• [Joblib] joblib 1.4+ submit, shared-argument storage/cache, and the missing redis extra. by @JosepSampe
• [IBM] COS token manager with ibm_botocore. by @JosepSampe

Removed

• [Storage] Removed the infinispan_hotrod storage backend (deprecated). by @JosepSampe