Search Results for "parallel" - Page 2
Sort By:
Showing 232 open source projects for "parallel"
View related business solutions-
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Implicit
Fast Python collaborative filtering for implicit feedback datasets
This project provides fast Python implementations of several different popular recommendation algorithms for implicit feedback datasets. All models have multi-threaded training routines, using Cython and OpenMP to fit the models in parallel among all available CPU cores. In addition, the ALS and BPR models both have custom CUDA kernels - enabling fitting on compatible GPU’s. This library also supports using approximate nearest neighbour libraries such as Annoy, NMSLIB and Faiss for speeding up making recommendations. -
2
jlens
Companion code for the global workspace interpretability paper
...The transformed vectors are decoded through the model’s own unembedding into ranked vocabulary predictions. The package can fit new lenses, load saved ones, apply them to prompts, and merge results from parallel fitting jobs. Interactive layer-by-position views reveal how token rankings evolve across the network and compare them with the model’s final output. It supports open-weight Hugging Face decoder models, with Qwen used in the included examples. The repository also provides synthetic evaluation data and an end-to-end notebook, but it is not maintained. -
3
Flow-Next
Plan-first AI workflow plugin for Claude Code, OpenAI Codex
Flow-Next is a workflow orchestration tool designed to manage complex processes by structuring tasks into organized and repeatable pipelines. It focuses on improving productivity by allowing users to define workflows that can be executed step by step or in parallel. The system emphasizes modularity, enabling tasks to be broken down into smaller components that can be reused across different workflows. It supports integration with various tools and services, making it adaptable to different environments. The project is designed to handle both simple and complex workflows, providing flexibility for a wide range of use cases. ... -
4
BigMac
An open-source toolkit for BigMac-style pipeline-parallel training
BigMac is an open-source toolkit for pipeline-parallel training of multimodal large language models. It preserves optimized language-model pipeline schedules while placing encoder and generator work around them. This design reduces activation memory without bringing back cross-module pipeline bubbles. Its scheduler creates global operator plans, while its executor runs those plans through a shared schedule abstraction. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
MiroFish
A Simple and Universal Swarm Intelligence Engine
MiroFish is a next-generation artificial intelligence prediction engine that leverages multi-agent technology and swarm-intelligence simulation to model, simulate, and forecast complex real-world scenarios. The system extracts “seed” information from sources such as breaking news, policy documents, and market signals to construct a high-fidelity digital parallel world populated by thousands of virtual agents with independent memory and behavior rules. Users can inject variables or conditions into this simulated environment from a “god’s eye view,” enabling iterative prediction of future trends under different assumptions, which can be useful for decision support, scenario planning, or creative exploration. ... -
6
yt-dlp
A youtube-dl fork with additional features and fixes
yt-dlp is a youtube-dl fork based on the now inactive youtube-dlc. The main focus of this project is adding new features and patches while also keeping up to date with the original project -
7
Open SWE
Open source async coding agent that plans, codes, and opens PRs
...Built with LangGraph, it can understand a codebase, generate a structured plan, and execute code changes from start to finish without constant human intervention. It operates in a cloud-based environment where tasks are processed asynchronously, allowing multiple coding jobs to run in parallel in isolated sandboxes. It integrates directly with development workflows by responding to triggers from tools like GitHub, enabling users to initiate tasks through issues or comments. Open SWE is capable of creating commits and automatically opening pull requests once implementation is complete, effectively closing the loop on development tasks. ... -
8
magentic
Seamlessly integrate LLMs as Python functions
Easily integrate Large Language Models into your Python code. Simply use the @prompt and @chatprompt decorators to create functions that return structured output from the LLM. Mix LLM queries and function calling with regular Python code to create complex logic. -
9
Megatron
Ongoing research training transformer models at scale
Megatron is a large, powerful transformer developed by the Applied Deep Learning Research team at NVIDIA. This repository is for ongoing research on training large transformer language models at scale. We developed efficient, model-parallel (tensor, sequence, and pipeline), and multi-node pre-training of transformer based models such as GPT, BERT, and T5 using mixed precision. Megatron is also used in NeMo Megatron, a framework to help enterprises overcome the challenges of building and training sophisticated natural language processing models with billions and trillions of parameters. ... -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
10
MCP Agent Mail
Asynchronous coordination layer for AI coding agents
...It gives each agent a persistent identity, inbox, outbox, searchable history, and threaded Markdown conversations. Agents can send decisions, status updates, images, and attachments without relying on a human to relay context between parallel sessions. Advisory file reservations let an agent declare intended edits to files or patterns, reducing accidental overlap without enforcing rigid locks. Git stores human-auditable communication artifacts, while SQLite supports indexing, search, and operational queries. The HTTP-only FastMCP server works with clients such as Claude Code, Codex, Gemini CLI, and other MCP-compatible tools. ... -
11
OpenSRE
Build your own AI SRE agents. The open source toolkit for the AI era
...When an alert is triggered, the system autonomously analyzes correlated signals, identifies anomalies, and generates structured investigation reports with probable causes and recommended actions. Its multi-agent architecture allows parallel reasoning across systems, mimicking how experienced SRE teams debug complex issues. The platform also incorporates memory and knowledge graph capabilities to learn from past incidents and improve future investigations. It is designed to run locally within an organization’s infrastructure, ensuring data privacy and compliance. -
12
mosdepth
fast BAM/CRAM depth calculation for WGS, exome, or targeted sequencing
mosdepth is a fast BAM/CRAM depth calculation tool for genomic data, allowing efficient computation of sequencing coverage. -
13
FuXi
FuXi is a fast, self-contained AI coding agent
...It supports cost-aware routing and automatic failover across multiple LLM providers, including OpenAI-compatible services and other supported backends. More than 50 built-in tools cover file operations, shell access, search, diagnostics, Jupyter, browser use, background tasks, and parallel sub-agents. Sessions are persistent, extensible through MCP, hooks, skills, and plugins, and protected by command classification, permissions, and audit logging. -
14
Kiro Crew
A persistent workspace for development work that self-improves
Kiro Crew is an open-source persistent development workspace that keeps AI-assisted work running beyond a single chat session. It can operate locally, in Docker, or on a remote machine controlled by the user. Sessions, memory, schedules, checkpoints, and learned preferences survive restarts and can influence later work. Long-running tasks can plan steps, execute them, validate results, retry failures, and resume from saved checkpoints. The system supports subagents, reusable skills, MCP... -
15
Mctx
Monte Carlo tree search in JAX
mctx is a Monte Carlo Tree Search (MCTS) library developed by Google DeepMind for reinforcement learning research. It enables efficient and flexible implementation of MCTS algorithms, including those used in AlphaZero and MuZero. -
16
PyBoy
Game Boy emulator written in Python
PyBoy is an open-source Game Boy emulator written in Python, designed for both gameplay and AI experimentation. It allows users to run classic Game Boy games while providing a powerful API for automation, scripting, and reinforcement learning. Developers can interact directly with game memory, inputs, and screen data, making it ideal for training bots and analyzing game mechanics. PyBoy emphasizes performance, enabling accelerated emulation speeds and frame skipping for large-scale... -
17
nbdev
Create delightful software with Jupyter Notebooks
nbdev is a notebook-driven development platform (by fast.ai/AnswerDotAI) enabling you to write code, tests, documentation, and deploy software, all from Jupyter Notebooks. It provides a unified literate programming workflow where you can tag notebook cells for export to Python modules, auto-generate documentation via Quarto (and host it on GitHub Pages), run tests embedded in notebooks, manage clean notebooks with Git-friendly metadata hooks, and seamlessly publish packages to PyPI/conda,... -
18
VectorizedMultiAgentSimulator (VMAS)
VMAS is a vectorized differentiable simulator
VectorizedMultiAgentSimulator is a high-performance, vectorized simulator for multi-agent systems, focusing on large-scale agent interactions in shared environments. It is designed for research in multi-agent reinforcement learning, robotics, and autonomous systems where thousands of agents need to be simulated efficiently. -
19
DataChain
AI-data warehouse to enrich, transform and analyze unstructured data
Datachain enables multimodal API calls and local AI inferences to run in parallel over many samples as chained operations. The resulting datasets can be saved, versioned, and sent directly to PyTorch and TensorFlow for training. Datachain can persist features of Python objects returned by AI models, and enables vectorized analytical operations over them. The typical use cases are data curation, LLM analytics and validation, image segmentation, pose detection, and GenAI alignment. ... -
20
Blade Build System
Blade is a powerful build system from Tencent
An easy-to-use, fast and modern build system for trunk-based development in large-scale mono repo codebase. The code on the master branch is the development version and should be considered as alpha version. Please prefer using the version on the tags in your formal environment. We will release the verified version on the large-scale internal code base to the tag from time to time. -
21
Parallax
Parallax is a distributed model serving framework
Parallax is a decentralized inference framework designed to run large language models across distributed computing resources. Instead of relying on centralized GPU clusters in data centers, the system allows multiple heterogeneous machines to collaborate in serving AI inference workloads. Parallax divides model layers across different nodes and dynamically coordinates them to form a complete inference pipeline. A two-stage scheduling architecture determines how model layers are allocated to... -
22
Cangjie Skill
Distill high-value content like books, long videos, podcasts, and more
cangjie-skill is a workflow for converting books and other long-form knowledge into executable AI skill packs. Its goal is structured reuse rather than producing another summary or set of reading notes. The seven-stage RIA-TV++ pipeline analyzes the full source, extracts candidate frameworks, verifies them, constructs skill modules, links related ideas, pressure-tests behavior, and prepares delivery files. Each accepted skill records supporting material, a reconstructed explanation,... -
23
Barman
Backup and Recovery Manager for PostgreSQL
Barman (Backup and Recovery Manager) is an enterprise-grade tool for managing backups and disaster recovery of PostgreSQL databases. It supports both full and incremental backups, Point-In-Time Recovery (PITR), and remote backup via SSH. Barman is widely used by DBAs to ensure secure, reliable, and consistent backups in production environments. -
24
Atropos
Language Model Reinforcement Learning Environments frameworks
...It provides foundational tooling for asynchronous RL loops where environment services communicate with trainers and inference engines, enabling complex workflow orchestration in distributed and parallel setups. This framework facilitates experimentation with RLHF (Reinforcement Learning from Human Feedback), RLAIF, or multi-turn training approaches by abstracting environment logic, scoring, and logging into reusable components. -
25
PyOpenCL
OpenCL integration for Python, plus shiny features
PyOpenCL is a Python wrapper for the OpenCL framework, providing seamless access to parallel computing on CPUs, GPUs, and other accelerators. It enables developers to harness the full power of heterogeneous computing directly from Python, combining Python’s ease of use with the performance benefits of OpenCL. PyOpenCL also includes convenient features for managing memory, compiling kernels, and interfacing with NumPy, making it a preferred choice in scientific computing, data analysis, and machine learning workflows that demand acceleration.
