Search Results for "parallel"
Sort By:
Showing 232 open source projects for "parallel"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
1
parallel-ssh
Asynchronous parallel SSH client library.
parallel-ssh is an asynchronous parallel SSH library designed for large-scale automation. It differentiates itself from alternatives, other libraries and higher-level frameworks like Ansible or Chef in several ways. -
2
Dask
Parallel computing with task scheduling
Dask is a Python library for parallel and distributed computing, designed to scale analytics workloads from single machines to large clusters. It integrates with familiar tools like NumPy, Pandas, and scikit-learn while enabling execution across cores or nodes with minimal code changes. Dask excels at handling large datasets that don’t fit into memory and is widely used in data science, machine learning, and big data pipelines. -
3
pgsync
Postgres to Elasticsearch/OpenSearch sync
pgsync is a lightweight tool for syncing Postgres databases across environments, such as from production to staging. It allows selective table syncing, data masking, and parallel copying for fast and safe data migration. pgsync is ideal for developers who need realistic test data without exposing sensitive information. -
4
Brax
Massively parallel rigidbody physics simulation
Brax is a fast and fully differentiable physics engine for large-scale rigid body simulations, built on JAX. It is designed for research in reinforcement learning and robotics, enabling efficient simulations and gradient-based optimization. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
nbmake
Pytest plugin for testing notebooks
Pytest plugin for testing and releasing notebook documentation. To raise the quality of scientific material through better automation. Research/Machine Learning Software Engineers who maintain packages/teaching materials with documentation written in notebooks. -
6
Crawl4AI
Open-source LLM Friendly Web Crawler & Scraper
Crawl4AI is a high-performance, AI‑ready web crawler tailored for LLM data ingestion and RAG pipelines. It supports adaptive crawling heuristics (stopping when enough info is gathered), structured markdown output, and high-speed parallel execution. Designed to operate at scale with optional Docker deployment and framework integrations. -
7
Claude Ads
Comprehensive paid advertising audit & optimization skill
...The system generates structured reports, identifies inefficiencies, and suggests optimization strategies based on industry benchmarks. It supports platforms like Google Ads, Meta Ads, TikTok, LinkedIn, and more, offering a unified analysis workflow. The architecture uses parallel subagents to speed up audits and includes financial modeling and A/B testing guidance. It runs locally, ensuring privacy and control over sensitive advertising data. The project is aimed at replacing manual audit workflows with fast, automated, and repeatable analysis. -
8
mosaicml composer
Supercharge Your Model Training
...The framework is intended for modern workloads that may span anything from a single GPU to very large distributed training environments, which makes it suitable for both experimentation and production-scale development. It includes built-in support for distributed training strategies such as Fully Sharded Data Parallelism and standard Distributed Data Parallel execution, helping teams scale models without having to assemble as much infrastructure by hand. -
9
HunyuanVideo
HunyuanVideo: A Systematic Framework For Large Video Generation Model
...The framework aims to push the boundaries of video generation quality, incorporating multiple innovative approaches to improve the realism and coherence of the generated content. Release of FP8 model weights to reduce GPU memory usage / improve efficiency. Parallel inference code to speed up sampling, utilities and tests included. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
AnySearch Skill
Unified real-time search engine skill for AI agents
AnySearch Skill is a real-time search engine skill for AI agents. It gives agents a structured way to search the web, run vertical searches, perform parallel batch searches, and extract full-page content. The project is packaged as a skill rather than a standalone search application, so it is meant to be installed into compatible AI-agent environments. It supports multiple domain-specific search categories, making it useful when general web search is too broad. The skill can also fetch page content after a URL is found, which helps agents answer questions from source material rather than snippets alone. ... -
11
vLLM
A high-throughput and memory-efficient inference and serving engine
vLLM is a fast and easy-to-use library for LLM inference and serving. High-throughput serving with various decoding algorithms, including parallel sampling, beam search, and more. -
12
pyinfra
pyinfra turns Python code into shell commands
...Designed as an alternative to tools like Ansible, pyinfra prioritizes speed, scalability, and developer flexibility while maintaining a declarative operational model. It supports ad-hoc command execution, reusable operations, inventory management, and parallel deployments across thousands of hosts. The framework integrates naturally with existing DevOps ecosystems and allows users to create highly customizable deployment logic using native Python syntax. Its architecture combines infrastructure-as-code concepts with efficient remote execution, making it suitable for modern cloud and server automation workflows. -
13
PRAXIST
Autonomous research system for measurable computer-executable research
PRAXIST is an autonomous research system for measurable, computer-executable problems. It turns an already runnable project into a persistent research process instead of a series of disconnected prompts. Parallel research peers explore competing hypotheses and implementations while evaluators convert outcomes into structured evidence. That evidence is carried across generations so later work can build on promising strategies and avoid repeating weak ones. The system supports multi-metric evaluation, quality-diversity methods, resource-aware scheduling, and durable evidence tracking. ... -
14
CUDA Python
Performance meets Productivity
...The project is designed to simplify GPU programming by offering Pythonic abstractions while still exposing the full power of CUDA for advanced users. It integrates tightly with the broader Python GPU ecosystem, including Numba for kernel compilation and CCCL for parallel primitives, allowing developers to write performant code without leaving Python. The toolkit also includes utilities for profiling, memory management, distributed computing, and numerical operations, making it suitable for scientific computing, AI, and data processing workloads. -
15
Eigent
The Open Source Cowork Desktop to Unlock Your Exceptional Productivity
Eigent is an open-source cowork desktop application designed to help you build, manage, and deploy a custom AI workforce. It enables multiple specialized AI agents to collaborate in parallel, turning complex workflows into automated, end-to-end tasks. Built on the CAMEL-AI multi-agent framework, Eigent emphasizes productivity, flexibility, and transparent system design. You can run Eigent fully locally for maximum privacy and data control, or choose a cloud-connected experience for quick access. The platform supports a wide range of AI models and integrates powerful tools through the Model Context Protocol (MCP). ... -
16
Loki Mode
Multi-agent autonomous startup system for Claude Code
...It orchestrates dozens of agent types across swarms that handle designated roles — such as architecture, coding, QA, deployment, and business workflows — running in parallel to cover both engineering and operational tasks without continuous human intervention. By supporting multiple AI providers (like Claude Code, OpenAI Codex CLI, and Google Gemini CLI), loki-mode dynamically selects and spawns only the needed agents for a given project, optimizing computational resources and task throughput. Its Reason-Act-Reflect-Verify (RARV) cycle with self-verification loops emphasizes quality and resilience, automating end-to-end development lifecycles. -
17
Otter-Grader
A Python and R autograding solution
...It is designed to work with classes at any scale by abstracting away the autograding internals in a way that is compatible with any instructor's assignment distribution and collection pipeline. Otter supports local grading through parallel Docker containers, grading using the autograder platforms of 3rd party learning management systems (LMSs), the deployment of an Otter-managed grading virtual machine, and a client package that allows students to run public checks on their own machines. Otter is designed to grade Python scripts and Jupyter Notebooks, and is compatible with a few different LMSs, including Canvas and Gradescope. -
18
DFlash
Block Diffusion for Ultra-Fast Speculative Decoding
DFlash is an open-source framework for ultra-fast speculative decoding using a lightweight block diffusion model to draft text in parallel with a target large language model, dramatically improving inference speed without sacrificing generation quality. It acts as a “drafter” that proposes likely continuations which the main model then verifies, enabling significant throughput gains compared to traditional autoregressive decoding methods that generate token by token. -
19
HunyuanVideo-I2V
A Customizable Image-to-Video Model based on HunyuanVideo
...It extends video generation so that given a static reference image plus an optional prompt, it generates a video sequence that preserves the reference image’s identity (especially in the first frame) and allows stylized effects via LoRA adapters. The repository includes pretrained weights, inference and sampling scripts, training code for LoRA effects, and support for parallel inference via xDiT. Resolution, video length, stability mode, flow shift, seed, CPU offload etc. Parallel inference support using xDiT for multi-GPU speedups. LoRA training / fine-tuning support to add special effects or customize generation. -
20
Local Deep Research
95% on SimpleQA (e.g. Qwen3.6-27B on a 3090)
...It runs locally, giving users full control over their data, privacy, and infrastructure while supporting both local and cloud-based LLMs. The system breaks down complex queries into smaller steps, performs parallel searches across web and academic sources, and generates structured, citation-backed reports. It also supports personal document ingestion through vector search, enabling users to build a private, searchable knowledge base. The platform includes a web interface, Docker-based deployment, and flexible configuration options, making it accessible to both developers and researchers. ... -
21
Swarms
Enterprise multi-agent orchestration framework for scalable AI apps
Swarms is an enterprise-grade multi-agent orchestration framework designed to help developers build, manage, and scale collaborative AI systems composed of multiple agents. It provides a structured infrastructure for coordinating agents in hierarchical, parallel, or sequential workflows, enabling complex task execution across distributed components. It emphasizes production readiness, offering modular architecture, high availability, and observability features suitable for large-scale deployments. It supports integration with multiple model providers and existing ecosystems, allowing developers to combine different AI tools and frameworks within a unified system. ... -
22
Make It heavy
A Python framework that emulates Grok Heavy functionality
Make It heavy is a Python framework for producing deeper AI analysis through multi-agent orchestration. It is designed to emulate the style of Grok Heavy by splitting a user query into several specialized research angles. The system runs four agents in parallel so each one can explore the problem from a different perspective. It then combines their outputs into one unified answer through an intelligent synthesis step. The framework uses OpenRouter for model access and can also run in single-agent mode for simpler tasks. Overall, it is useful for users who want broader research coverage, richer reasoning diversity, and structured multi-agent responses from one command-line workflow. -
23
Apodex FrontierAgent
FrontierAgent, our agent framework, open-sourced alongside it
...Its ReAct workflow provides a stateful agent that can research, read files, execute commands, and create deliverables inside a task-scoped sandbox. Agent Team mode adds a coordinator that divides work among parallel sub-agents and synthesizes their results. A live task board tracks pending, active, completed, blocked, and canceled work. Users can provide new instructions while an agent is running without discarding the active session. The same modular workflow engine also powers benchmark evaluations and can connect to OpenAI-compatible model endpoints. -
24
Inspect Petri
An alignment auditing agent capable of exploring alignment hypothesis
...The system supports major model APIs and comes with starter seeds and judge dimensions, enabling minutes-to-insight workflows for questions like reward hacking, self-preservation, or eval awareness. Petri is designed for parallel exploration: it spins many audits in flight, aggregates findings, and highlights transcripts that deserve human review. -
25
GenAI Processors
GenAI Processors is a lightweight Python library
...Its central abstraction is the Processor, a unit of work that consumes an asynchronous stream of parts (text, images, audio, JSON) and produces another stream, making it natural to chain operations and keep everything streaming end-to-end. Processors can be composed sequentially (to build multi-step flows) or in parallel (to fan-out work and merge results), which makes sophisticated agent behaviors easy to express with simple operators. The library offers built-in processors for classic turn-based Gemini calls as well as Live API streaming, so you can mix “batch” and real-time interactions in the same graph. It leans on Python’s asyncio to coordinate concurrency, handle network I/O, and juggle background compute threads without blocking.
