Search Results for "parallel"
Sort By:
Showing 1252 open source projects for "parallel"
View related business solutions-
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
parallel-ssh
Asynchronous parallel SSH client library.
parallel-ssh is an asynchronous parallel SSH library designed for large-scale automation. It differentiates itself from alternatives, other libraries and higher-level frameworks like Ansible or Chef in several ways. -
2
Orca
Orca is the ADE for working with a fleet of parallel agents
...Its focus is parallel agent work, development orchestration, and a more structured workspace for agent-driven coding. Overall, it is built for teams and individual developers who want to coordinate many AI coding sessions from one environment. -
3
FileTrees.jl
Parallel file processing made easy
...When computing lazy trees, these values are held in distributed memory and operated on in parallel. -
4
Dask
Parallel computing with task scheduling
Dask is a Python library for parallel and distributed computing, designed to scale analytics workloads from single machines to large clusters. It integrates with familiar tools like NumPy, Pandas, and scikit-learn while enabling execution across cores or nodes with minimal code changes. Dask excels at handling large datasets that don’t fit into memory and is widely used in data science, machine learning, and big data pipelines. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
EnvPool
C++-based high-performance parallel environment execution engine
EnvPool is a fast, asynchronous, and parallel RL environment library designed for scaling reinforcement learning experiments. Developed by SAIL at Singapore, it leverages C++ backend and Python frontend for extremely high-speed environment interaction, supporting thousands of environments running in parallel on a single machine. It's compatible with Gymnasium API and RLlib, making it suitable for scalable training pipelines. -
6
Apache Beam
Unified programming model for Batch and Streaming
Apache Beam is an open source, unified programming model to define both batch and streaming data-parallel processing pipelines, as well as certain language-specific SDKs for constructing pipelines and Runners. These pipelines are executed on one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow. Beam is especially useful for Embarrassingly Parallel data processing tasks, and caters to the different needs and backgrounds of end users, SDK writers and runner writers. -
7
golangci-lint
Fast linters Runner for Go
golangci-lint is a fast Go linters runner. It runs linters in parallel, uses caching, supports yaml config, has integrations with all major IDE and has dozens of linters included. ⚡ Very fast: runs linters in parallel, reuses Go build cache and caches analysis results. Yaml-based configuration. Integrations with VS Code, Sublime Text, GoLand, GNU Emacs, Vim, Atom, GitHub Actions. A lot of linters included, no need to install them. -
8
101-0250-00
ETH course - Solving PDEs in parallel on GPUs
This course aims to cover state-of-the-art methods in modern parallel Graphical Processing Unit (GPU) computing, supercomputing and code development with applications to natural sciences and engineering. -
9
Dagger.jl
A framework for out-of-core and parallel execution
Dagger.jl is a framework for out-of-core and parallel computing in Julia that allows users to construct and execute dynamic task graphs. It is designed for large-scale, distributed, and memory-efficient computations. Dagger supports lazy evaluation and scheduling across multiple threads or machines, enabling high-performance workflows for data processing, scientific computing, and machine learning. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
mprocs
Run multiple commands in parallel
mprocs runs multiple commands in parallel and shows output of each command separately. When you work on a project you very often need the same list of commands to be running. For example: webpack serve, just --watch, node src/server.js. With mprocs you can list these commands in mprocs.yaml and run all of them by running mprocs. Then you can switch between the outputs of running commands and interact with them. -
11
AudioBookConverter
Improved AudioBookConverter based on freeipodsoftware release
...The software supports a wide range of input formats including MP3, FLAC, and AAC, and provides flexible output options for different devices. It includes intelligent artwork handling, automatically sourcing and merging cover images from files or directories. The application uses parallel encoding to improve performance, making it efficient for large audiobook collections. It also supports advanced chapter management, including importing and editing chapter structures. Overall, it simplifies audiobook creation while maintaining high-quality output and metadata integrity. -
12
pgsync
Postgres to Elasticsearch/OpenSearch sync
pgsync is a lightweight tool for syncing Postgres databases across environments, such as from production to staging. It allows selective table syncing, data masking, and parallel copying for fast and safe data migration. pgsync is ideal for developers who need realistic test data without exposing sensitive information. -
13
Piscina
A fast, efficient Node.js Worker Thread Pool implementation
Piscina is a fast, efficient Node.js worker thread pool implementation, designed to perform heavy CPU-bound tasks in parallel, thereby improving application performance. -
14
LightGBM
Gradient boosting framework based on decision tree algorithms
LightGBM or Light Gradient Boosting Machine is a high-performance, open source gradient boosting framework based on decision tree algorithms. Compared to other boosting frameworks, LightGBM offers several advantages in terms of speed, efficiency and accuracy. Parallel experiments have shown that LightGBM can attain linear speed-up through multiple machines for training in specific settings, all while consuming less memory. LightGBM supports parallel and GPU learning, and can handle large-scale data. It’s become widely-used for ranking, classification and many other machine learning tasks. -
15
bild
Image processing algorithms in pure Go
...Package histogram provides basic histogram types and functions to analyze RGBA images. Package paint provides functions to edit a group of pixels on an image. Package parallel provides helper functions for the dispatching of parallel jobs. -
16
Av1an
Cross-platform command-line AV1 / VP9 / HEVC / H264 encoding framework
Av1an is a command-line encoding framework designed to efficiently encode video into the AV1 format using distributed and parallel processing techniques. It acts as an orchestrator that splits video files into chunks, processes them in parallel using encoders like SVT-AV1, AOM, or rav1e, and then merges the results into a final output. The tool is optimized for high-quality encoding while reducing total processing time through multi-core and multi-machine support. -
17
StreamEx
Enhancing Java Stream API
This library defines four classes, StreamEx, IntStreamEx, LongStreamEx, DoubleStreamEx which are fully compatible with Java 8 stream classes and provide many additional useful methods. Also EntryStream class is provided which represents the stream of map entries and provides additional functionality for this case. Finally, there are some new useful collectors defined in MoreCollectors class as well as primitive collectors concept. -
18
Sogou C++ Workflow
C++ parallel computing and asynchronous networking engine
As Sogou`s C++ server engine, Sogou C++ Workflow supports almost all back-end C++ online services of Sogou, including all search services, cloud input method, online advertisements, etc., handling more than 10 billion requests every day. This is an enterprise-level programming engine in light and elegant design which can satisfy most C++ back-end development requirements. -
19
compress
Optimized Go Compression Packages
...Optimized deflate packages which can be used as a dropin replacement for gzip, zip and zlib. snappy is a drop-in replacement for github.com/golang/snappy offering better compression and concurrent streams. huff0 and FSE implementations for raw entropy encoding. gzhttp Provides client and server wrappers for handling gzipped requests efficiently. pgzip is a separate package that provides a very fast parallel gzip implementation. Stream decompression is now faster on asynchronous since the goroutine allocation much more effectively splits the workload. On typical streams, this will typically use 2 cores fully for decompression. When a stream has finished decoding no goroutines will be left over, so decoders can now safely be pooled and still be garbage collected. -
20
CUDA Core Compute Libraries (CCCL)
CUDA Core Compute Libraries
...It brings together Thrust, CUB, and libcudacxx, which collectively provide high-level abstractions, low-level performance primitives, and a CUDA-compatible standard library for GPU programming. The goal of CCCL is to simplify CUDA development by offering reusable building blocks that enable developers to write efficient and scalable parallel code without starting from scratch. Thrust provides a high-level interface for parallel algorithms, while CUB delivers highly optimized primitives for device-level operations, and libcudacxx ensures compatibility with modern C++ standards. By unifying these components, CCCL reduces duplication and improves developer productivity while maintaining performance across different GPU architectures. -
21
multi-agent-shogun
Samurai-inspired multi-agent system for Claude Code
multi-agent-shogun is a multi-agent orchestration system designed to coordinate multiple AI coding agents working in parallel. Inspired by the hierarchy of a feudal Japanese military structure, the system organizes agents into roles such as Shogun, Karo, and Ashigaru, which correspond to strategist, coordinator, and worker agents. A user interacts primarily with the Shogun agent by issuing natural language instructions that describe the desired tasks. -
22
Horust
Horust is a supervisor / init system written in rust
...Unlike traditional init systems, Horust focuses on stateless configuration using TOML files and aims to bring predictability and ease of use to system boot and service management. Written with Rust’s safety guarantees, Horust provides features like dependency handling, parallel service startup, and logging, making it suitable for containers, embedded systems, or minimal Linux environments where systemd is too complex or heavy. -
23
HYPRE
Parallel solvers for sparse linear systems featuring multigrid methods
Livermore’s HYPRE library of linear solvers makes possible larger, more detailed simulations by solving problems faster than traditional methods at large scales. It offers a comprehensive suite of scalable solvers for large-scale scientific simulation, featuring parallel multigrid methods for both structured and unstructured grid problems. The HYPRE library is highly portable and supports a number of languages. Work on HYPRE began in the late 1990s. It has since been used by research institutions and private companies to simulate groundwater flow, magnetic fusion energy plasmas in tokamaks and stellarators, blood flow through the heart, fluid flow in steam generators for nuclear power plants, and pumping activity in oil reservoirs, to name just a few areas. ... -
24
OpenCL.jl
OpenCL Julia bindings
Julia interface for the OpenCL parallel computation API. This package aims to be a complete solution for OpenCL programming in Julia, similar in scope to PyOpenCL for Python. It provides a high level API for OpenCL to make programing hardware accelerators, such as GPUs, FPGAs, and DSPs, as well as multicore CPUs much less onerous. -
25
pgBadger
A fast PostgreSQL Log Analyzer
...It parses PostgreSQL logs and generates detailed, visually appealing HTML reports, helping DBAs and developers understand query performance, connection issues, and system bottlenecks. With support for incremental analysis, gzip-compressed logs, and parallel processing, pgBadger is ideal for monitoring and optimizing PostgreSQL database activity in production environments.
