Search Results for "parallel"
Sort By:
Showing 223 open source projects for "parallel"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
parallel-ssh
Asynchronous parallel SSH client library.
parallel-ssh is an asynchronous parallel SSH library designed for large-scale automation. It differentiates itself from alternatives, other libraries and higher-level frameworks like Ansible or Chef in several ways. -
2
Dask
Parallel computing with task scheduling
Dask is a Python library for parallel and distributed computing, designed to scale analytics workloads from single machines to large clusters. It integrates with familiar tools like NumPy, Pandas, and scikit-learn while enabling execution across cores or nodes with minimal code changes. Dask excels at handling large datasets that don’t fit into memory and is widely used in data science, machine learning, and big data pipelines. -
3
pgsync
Postgres to Elasticsearch/OpenSearch sync
pgsync is a lightweight tool for syncing Postgres databases across environments, such as from production to staging. It allows selective table syncing, data masking, and parallel copying for fast and safe data migration. pgsync is ideal for developers who need realistic test data without exposing sensitive information. -
4
Crawl4AI
Open-source LLM Friendly Web Crawler & Scraper
Crawl4AI is a high-performance, AI‑ready web crawler tailored for LLM data ingestion and RAG pipelines. It supports adaptive crawling heuristics (stopping when enough info is gathered), structured markdown output, and high-speed parallel execution. Designed to operate at scale with optional Docker deployment and framework integrations. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
HunyuanVideo-I2V
A Customizable Image-to-Video Model based on HunyuanVideo
...It extends video generation so that given a static reference image plus an optional prompt, it generates a video sequence that preserves the reference image’s identity (especially in the first frame) and allows stylized effects via LoRA adapters. The repository includes pretrained weights, inference and sampling scripts, training code for LoRA effects, and support for parallel inference via xDiT. Resolution, video length, stability mode, flow shift, seed, CPU offload etc. Parallel inference support using xDiT for multi-GPU speedups. LoRA training / fine-tuning support to add special effects or customize generation. -
6
Brax
Massively parallel rigidbody physics simulation
Brax is a fast and fully differentiable physics engine for large-scale rigid body simulations, built on JAX. It is designed for research in reinforcement learning and robotics, enabling efficient simulations and gradient-based optimization. -
7
HunyuanVideo
HunyuanVideo: A Systematic Framework For Large Video Generation Model
...The framework aims to push the boundaries of video generation quality, incorporating multiple innovative approaches to improve the realism and coherence of the generated content. Release of FP8 model weights to reduce GPU memory usage / improve efficiency. Parallel inference code to speed up sampling, utilities and tests included. -
8
AnySearch Skill
Unified real-time search engine skill for AI agents
AnySearch Skill is a real-time search engine skill for AI agents. It gives agents a structured way to search the web, run vertical searches, perform parallel batch searches, and extract full-page content. The project is packaged as a skill rather than a standalone search application, so it is meant to be installed into compatible AI-agent environments. It supports multiple domain-specific search categories, making it useful when general web search is too broad. The skill can also fetch page content after a URL is found, which helps agents answer questions from source material rather than snippets alone. ... -
9
vLLM
A high-throughput and memory-efficient inference and serving engine
vLLM is a fast and easy-to-use library for LLM inference and serving. High-throughput serving with various decoding algorithms, including parallel sampling, beam search, and more. -
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
10
nbmake
Pytest plugin for testing notebooks
Pytest plugin for testing and releasing notebook documentation. To raise the quality of scientific material through better automation. Research/Machine Learning Software Engineers who maintain packages/teaching materials with documentation written in notebooks. -
11
Eigent
The Open Source Cowork Desktop to Unlock Your Exceptional Productivity
Eigent is an open-source cowork desktop application designed to help you build, manage, and deploy a custom AI workforce. It enables multiple specialized AI agents to collaborate in parallel, turning complex workflows into automated, end-to-end tasks. Built on the CAMEL-AI multi-agent framework, Eigent emphasizes productivity, flexibility, and transparent system design. You can run Eigent fully locally for maximum privacy and data control, or choose a cloud-connected experience for quick access. The platform supports a wide range of AI models and integrates powerful tools through the Model Context Protocol (MCP). ... -
12
Open SWE
Open source async coding agent that plans, codes, and opens PRs
...Built with LangGraph, it can understand a codebase, generate a structured plan, and execute code changes from start to finish without constant human intervention. It operates in a cloud-based environment where tasks are processed asynchronously, allowing multiple coding jobs to run in parallel in isolated sandboxes. It integrates directly with development workflows by responding to triggers from tools like GitHub, enabling users to initiate tasks through issues or comments. Open SWE is capable of creating commits and automatically opening pull requests once implementation is complete, effectively closing the loop on development tasks. ... -
13
BigMac
An open-source toolkit for BigMac-style pipeline-parallel training
BigMac is an open-source toolkit for pipeline-parallel training of multimodal large language models. It preserves optimized language-model pipeline schedules while placing encoder and generator work around them. This design reduces activation memory without bringing back cross-module pipeline bubbles. Its scheduler creates global operator plans, while its executor runs those plans through a shared schedule abstraction. -
14
CUDA Python
Performance meets Productivity
...The project is designed to simplify GPU programming by offering Pythonic abstractions while still exposing the full power of CUDA for advanced users. It integrates tightly with the broader Python GPU ecosystem, including Numba for kernel compilation and CCCL for parallel primitives, allowing developers to write performant code without leaving Python. The toolkit also includes utilities for profiling, memory management, distributed computing, and numerical operations, making it suitable for scientific computing, AI, and data processing workloads. -
15
pyinfra
pyinfra turns Python code into shell commands
...Designed as an alternative to tools like Ansible, pyinfra prioritizes speed, scalability, and developer flexibility while maintaining a declarative operational model. It supports ad-hoc command execution, reusable operations, inventory management, and parallel deployments across thousands of hosts. The framework integrates naturally with existing DevOps ecosystems and allows users to create highly customizable deployment logic using native Python syntax. Its architecture combines infrastructure-as-code concepts with efficient remote execution, making it suitable for modern cloud and server automation workflows. -
16
Make It heavy
A Python framework that emulates Grok Heavy functionality
Make It heavy is a Python framework for producing deeper AI analysis through multi-agent orchestration. It is designed to emulate the style of Grok Heavy by splitting a user query into several specialized research angles. The system runs four agents in parallel so each one can explore the problem from a different perspective. It then combines their outputs into one unified answer through an intelligent synthesis step. The framework uses OpenRouter for model access and can also run in single-agent mode for simpler tasks. Overall, it is useful for users who want broader research coverage, richer reasoning diversity, and structured multi-agent responses from one command-line workflow. -
17
Loki Mode
Multi-agent autonomous startup system for Claude Code
...It orchestrates dozens of agent types across swarms that handle designated roles — such as architecture, coding, QA, deployment, and business workflows — running in parallel to cover both engineering and operational tasks without continuous human intervention. By supporting multiple AI providers (like Claude Code, OpenAI Codex CLI, and Google Gemini CLI), loki-mode dynamically selects and spawns only the needed agents for a given project, optimizing computational resources and task throughput. Its Reason-Act-Reflect-Verify (RARV) cycle with self-verification loops emphasizes quality and resilience, automating end-to-end development lifecycles. -
18
MiroFish
A Simple and Universal Swarm Intelligence Engine
MiroFish is a next-generation artificial intelligence prediction engine that leverages multi-agent technology and swarm-intelligence simulation to model, simulate, and forecast complex real-world scenarios. The system extracts “seed” information from sources such as breaking news, policy documents, and market signals to construct a high-fidelity digital parallel world populated by thousands of virtual agents with independent memory and behavior rules. Users can inject variables or conditions into this simulated environment from a “god’s eye view,” enabling iterative prediction of future trends under different assumptions, which can be useful for decision support, scenario planning, or creative exploration. ... -
19
OpenSRE
Build your own AI SRE agents. The open source toolkit for the AI era
...When an alert is triggered, the system autonomously analyzes correlated signals, identifies anomalies, and generates structured investigation reports with probable causes and recommended actions. Its multi-agent architecture allows parallel reasoning across systems, mimicking how experienced SRE teams debug complex issues. The platform also incorporates memory and knowledge graph capabilities to learn from past incidents and improve future investigations. It is designed to run locally within an organization’s infrastructure, ensuring data privacy and compliance. -
20
jlens
Companion code for the global workspace interpretability paper
...The transformed vectors are decoded through the model’s own unembedding into ranked vocabulary predictions. The package can fit new lenses, load saved ones, apply them to prompts, and merge results from parallel fitting jobs. Interactive layer-by-position views reveal how token rankings evolve across the network and compare them with the model’s final output. It supports open-weight Hugging Face decoder models, with Qwen used in the included examples. The repository also provides synthetic evaluation data and an end-to-end notebook, but it is not maintained. -
21
Claude Ads
Comprehensive paid advertising audit & optimization skill
...The system generates structured reports, identifies inefficiencies, and suggests optimization strategies based on industry benchmarks. It supports platforms like Google Ads, Meta Ads, TikTok, LinkedIn, and more, offering a unified analysis workflow. The architecture uses parallel subagents to speed up audits and includes financial modeling and A/B testing guidance. It runs locally, ensuring privacy and control over sensitive advertising data. The project is aimed at replacing manual audit workflows with fast, automated, and repeatable analysis. -
22
Flow-Next
Plan-first AI workflow plugin for Claude Code, OpenAI Codex
Flow-Next is a workflow orchestration tool designed to manage complex processes by structuring tasks into organized and repeatable pipelines. It focuses on improving productivity by allowing users to define workflows that can be executed step by step or in parallel. The system emphasizes modularity, enabling tasks to be broken down into smaller components that can be reused across different workflows. It supports integration with various tools and services, making it adaptable to different environments. The project is designed to handle both simple and complex workflows, providing flexibility for a wide range of use cases. ... -
23
mosaicml composer
Supercharge Your Model Training
...The framework is intended for modern workloads that may span anything from a single GPU to very large distributed training environments, which makes it suitable for both experimentation and production-scale development. It includes built-in support for distributed training strategies such as Fully Sharded Data Parallelism and standard Distributed Data Parallel execution, helping teams scale models without having to assemble as much infrastructure by hand. -
24
yt-dlp
A youtube-dl fork with additional features and fixes
yt-dlp is a youtube-dl fork based on the now inactive youtube-dlc. The main focus of this project is adding new features and patches while also keeping up to date with the original project -
25
Local Deep Research
95% on SimpleQA (e.g. Qwen3.6-27B on a 3090)
...It runs locally, giving users full control over their data, privacy, and infrastructure while supporting both local and cloud-based LLMs. The system breaks down complex queries into smaller steps, performs parallel searches across web and academic sources, and generates structured, citation-backed reports. It also supports personal document ingestion through vector search, enabling users to build a private, searchable knowledge base. The platform includes a web interface, Docker-based deployment, and flexible configuration options, making it accessible to both developers and researchers. ...
