Search Results for "parallel"
Sort By:
Showing 1791 open source projects for "parallel"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
parallel-ssh
Asynchronous parallel SSH client library.
parallel-ssh is an asynchronous parallel SSH library designed for large-scale automation. It differentiates itself from alternatives, other libraries and higher-level frameworks like Ansible or Chef in several ways. -
2
Orca
Orca is the ADE for working with a fleet of parallel agents
...Its focus is parallel agent work, development orchestration, and a more structured workspace for agent-driven coding. Overall, it is built for teams and individual developers who want to coordinate many AI coding sessions from one environment. -
3
StreamEx
Enhancing Java Stream API
This library defines four classes, StreamEx, IntStreamEx, LongStreamEx, DoubleStreamEx which are fully compatible with Java 8 stream classes and provide many additional useful methods. Also EntryStream class is provided which represents the stream of map entries and provides additional functionality for this case. Finally, there are some new useful collectors defined in MoreCollectors class as well as primitive collectors concept. -
4
Dask
Parallel computing with task scheduling
Dask is a Python library for parallel and distributed computing, designed to scale analytics workloads from single machines to large clusters. It integrates with familiar tools like NumPy, Pandas, and scikit-learn while enabling execution across cores or nodes with minimal code changes. Dask excels at handling large datasets that don’t fit into memory and is widely used in data science, machine learning, and big data pipelines. -
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
5
Dagger.jl
A framework for out-of-core and parallel execution
Dagger.jl is a framework for out-of-core and parallel computing in Julia that allows users to construct and execute dynamic task graphs. It is designed for large-scale, distributed, and memory-efficient computations. Dagger supports lazy evaluation and scheduling across multiple threads or machines, enabling high-performance workflows for data processing, scientific computing, and machine learning. -
6
AudioBookConverter
Improved AudioBookConverter based on freeipodsoftware release
...The software supports a wide range of input formats including MP3, FLAC, and AAC, and provides flexible output options for different devices. It includes intelligent artwork handling, automatically sourcing and merging cover images from files or directories. The application uses parallel encoding to improve performance, making it efficient for large audiobook collections. It also supports advanced chapter management, including importing and editing chapter structures. Overall, it simplifies audiobook creation while maintaining high-quality output and metadata integrity. -
7
The Futhark Programming Language
A data-parallel functional programming language
Futhark is a small programming language designed to be compiled into efficient parallel code. It is a statically typed, data-parallel, and purely functional array language in the ML family, and comes with a heavily optimizing ahead-of-time compiler that presently generates either GPU code via CUDA and OpenCL, or multi-threaded CPU code. Futhark is not designed for graphics programming, but can instead use the compute power of the GPU to accelerate data-parallel array computations. ... -
8
LAMMPS
Public development project of the LAMMPS MD software package
...LAMMPS is script-driven, so users can define simulation geometry, force fields, integration methods, output, and analysis behavior through input files. Its main value is combining broad scientific flexibility with scalable parallel performance for complex molecular and mesoscale simulations. -
9
pgsync
Postgres to Elasticsearch/OpenSearch sync
pgsync is a lightweight tool for syncing Postgres databases across environments, such as from production to staging. It allows selective table syncing, data masking, and parallel copying for fast and safe data migration. pgsync is ideal for developers who need realistic test data without exposing sensitive information. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
FileTrees.jl
Parallel file processing made easy
...When computing lazy trees, these values are held in distributed memory and operated on in parallel. -
11
101-0250-00
ETH course - Solving PDEs in parallel on GPUs
This course aims to cover state-of-the-art methods in modern parallel Graphical Processing Unit (GPU) computing, supercomputing and code development with applications to natural sciences and engineering. -
12
Emdash
Emdash is the Open-Source Agentic Development Environment
Emdash is an open-source agentic development environment that allows developers to orchestrate multiple AI coding agents in parallel within a unified desktop application. It introduces a new paradigm where coding tasks are delegated to independent AI agents, each operating in its own isolated Git worktree, enabling concurrent development workflows without conflicts. The platform is provider-agnostic, supporting a wide range of CLI-based AI coding tools such as Claude Code, Codex, and others, allowing developers to switch or combine models based on their needs. ... -
13
ego (lite)
The fastest browser for AI agents to run web automation
Ego Lite is a macOS browser designed for people and external AI agents to work in parallel. Each agent receives an isolated Space, allowing several browser tasks to run simultaneously without taking over the user's active tabs. Optional Chrome data migration carries over logins, cookies, extensions, and bookmarks so agents can use authenticated sessions with less setup. The ego-browser skill connects tools such as Codex, Claude Code, Cursor, and custom agent CLIs to the browser. ... -
14
Apache Beam
Unified programming model for Batch and Streaming
Apache Beam is an open source, unified programming model to define both batch and streaming data-parallel processing pipelines, as well as certain language-specific SDKs for constructing pipelines and Runners. These pipelines are executed on one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow. Beam is especially useful for Embarrassingly Parallel data processing tasks, and caters to the different needs and backgrounds of end users, SDK writers and runner writers. -
15
Piscina
A fast, efficient Node.js Worker Thread Pool implementation
Piscina is a fast, efficient Node.js worker thread pool implementation, designed to perform heavy CPU-bound tasks in parallel, thereby improving application performance. -
16
DL_POLY
General purpose classical molecular dynamics (MD) simulation software
DL_POLY is a general-purpose classical molecular dynamics simulation package developed at Daresbury Laboratory. It has evolved from older replicated-memory designs into a distributed-memory code suitable for modern parallel computing. The software can be built in serial form or with MPI for larger simulations. It is used for molecular modeling in chemistry, physics, materials science, and condensed-matter research. DL_POLY provides a mature simulation environment for studying atomic and molecular systems under classical force-field descriptions. Its main value is offering a long-running, research-grade MD package with a strong focus on parallel execution and general scientific use. -
17
HYPRE
Parallel solvers for sparse linear systems featuring multigrid methods
Livermore’s HYPRE library of linear solvers makes possible larger, more detailed simulations by solving problems faster than traditional methods at large scales. It offers a comprehensive suite of scalable solvers for large-scale scientific simulation, featuring parallel multigrid methods for both structured and unstructured grid problems. The HYPRE library is highly portable and supports a number of languages. Work on HYPRE began in the late 1990s. It has since been used by research institutions and private companies to simulate groundwater flow, magnetic fusion energy plasmas in tokamaks and stellarators, blood flow through the heart, fluid flow in steam generators for nuclear power plants, and pumping activity in oil reservoirs, to name just a few areas. ... -
18
Av1an
Cross-platform command-line AV1 / VP9 / HEVC / H264 encoding framework
Av1an is a command-line encoding framework designed to efficiently encode video into the AV1 format using distributed and parallel processing techniques. It acts as an orchestrator that splits video files into chunks, processes them in parallel using encoders like SVT-AV1, AOM, or rav1e, and then merges the results into a final output. The tool is optimized for high-quality encoding while reducing total processing time through multi-core and multi-machine support. -
19
LightGBM
Gradient boosting framework based on decision tree algorithms
LightGBM or Light Gradient Boosting Machine is a high-performance, open source gradient boosting framework based on decision tree algorithms. Compared to other boosting frameworks, LightGBM offers several advantages in terms of speed, efficiency and accuracy. Parallel experiments have shown that LightGBM can attain linear speed-up through multiple machines for training in specific settings, all while consuming less memory. LightGBM supports parallel and GPU learning, and can handle large-scale data. It’s become widely-used for ranking, classification and many other machine learning tasks. -
20
future
R package: future: Unified Parallel and Distributed Processing in R
The future package in R provides a unified abstraction for asynchronous and/or parallel computation. It allows R expressions to be scheduled for future evaluation, with the result retrieved later, in a way decoupled from the specific backend used. This lets code be written in a way that works with sequential execution, multicore, multisession, cluster, or remote compute backends, without changing the high-level code. -
21
EnvPool
C++-based high-performance parallel environment execution engine
EnvPool is a fast, asynchronous, and parallel RL environment library designed for scaling reinforcement learning experiments. Developed by SAIL at Singapore, it leverages C++ backend and Python frontend for extremely high-speed environment interaction, supporting thousands of environments running in parallel on a single machine. It's compatible with Gymnasium API and RLlib, making it suitable for scalable training pipelines. -
22
Crawl4AI
Open-source LLM Friendly Web Crawler & Scraper
Crawl4AI is a high-performance, AI‑ready web crawler tailored for LLM data ingestion and RAG pipelines. It supports adaptive crawling heuristics (stopping when enough info is gathered), structured markdown output, and high-speed parallel execution. Designed to operate at scale with optional Docker deployment and framework integrations. -
23
multi-agent-shogun
Samurai-inspired multi-agent system for Claude Code
multi-agent-shogun is a multi-agent orchestration system designed to coordinate multiple AI coding agents working in parallel. Inspired by the hierarchy of a feudal Japanese military structure, the system organizes agents into roles such as Shogun, Karo, and Ashigaru, which correspond to strategist, coordinator, and worker agents. A user interacts primarily with the Shogun agent by issuing natural language instructions that describe the desired tasks. -
24
HunyuanVideo-I2V
A Customizable Image-to-Video Model based on HunyuanVideo
...It extends video generation so that given a static reference image plus an optional prompt, it generates a video sequence that preserves the reference image’s identity (especially in the first frame) and allows stylized effects via LoRA adapters. The repository includes pretrained weights, inference and sampling scripts, training code for LoRA effects, and support for parallel inference via xDiT. Resolution, video length, stability mode, flow shift, seed, CPU offload etc. Parallel inference support using xDiT for multi-GPU speedups. LoRA training / fine-tuning support to add special effects or customize generation. -
25
Soufflé
Datalog variant for tool designers crafting analyses in Horn clauses
Rapid prototyping for your analysis problems with logic; enabling deep design-space explorations; designed for large-scale static analysis; e.g., points-to analysis for Java, taint-analysis, and security checks. Futamura projections/partial evaluation for effective translation to parallel C++; optimized staged compilation; specialized data-structures for logical relations. Efficient translation to parallel C++ of Datalog programs (CAV'16, CC'16) Efficient interpretation using de-specialization techniques (PLDI'21) Specialized data structure for relations (PACT'19, PPoPP'19, PMAM'19) with optimal index selection (VLDB'18) Extended semantics of Datalog, e.g., permitting unbounded recursions with numbers and terms. ...
