Search Results for "parallel"
Sort By:
Showing 114 open source projects for "parallel"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
1
Dask
Parallel computing with task scheduling
Dask is a Python library for parallel and distributed computing, designed to scale analytics workloads from single machines to large clusters. It integrates with familiar tools like NumPy, Pandas, and scikit-learn while enabling execution across cores or nodes with minimal code changes. Dask excels at handling large datasets that don’t fit into memory and is widely used in data science, machine learning, and big data pipelines. -
2
FileTrees.jl
Parallel file processing made easy
...When computing lazy trees, these values are held in distributed memory and operated on in parallel. -
3
101-0250-00
ETH course - Solving PDEs in parallel on GPUs
This course aims to cover state-of-the-art methods in modern parallel Graphical Processing Unit (GPU) computing, supercomputing and code development with applications to natural sciences and engineering. -
4
OpenCL.jl
OpenCL Julia bindings
Julia interface for the OpenCL parallel computation API. This package aims to be a complete solution for OpenCL programming in Julia, similar in scope to PyOpenCL for Python. It provides a high level API for OpenCL to make programing hardware accelerators, such as GPUs, FPGAs, and DSPs, as well as multicore CPUs much less onerous. -
Full-stack observability with actually useful AI | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
5
Claude Code PM
Project management system for Claude Code using GitHub Issues
...Instead of relying on separate project management tools, CCPM uses GitHub issues as the single source of truth, helping teams turn product requirements documents into trackable tasks and epics with full traceability throughout the development lifecycle. It supports parallel execution of AI agents by isolating work in separate Git worktrees, preserving context and allowing multiple streams of work without interference, which addresses common pain points in AI-driven coding where context often disappears between sessions. -
6
Numaflow
Kubernetes-native platform to run massively parallel data/streaming
Numaflow is a Kubernetes-native tool for running massively parallel stream processing. A Numaflow Pipeline is implemented as a Kubernetes custom resource and consists of one or more source, data processing, and sink vertices. Numaflow installs in a few minutes and is easier and cheaper to use for simple data processing applications than a full-featured stream processing platform. -
7
targets
Function-oriented Make-like declarative workflows for R
The targets package is a pipeline / workflow management tool in R, designed to coordinate multi‐step computational workflows in data science / statistics. It tracks dependencies between “targets” (computational steps), skips steps whose upstream data or code hasn’t changed, supports parallel computation, branching (dynamic generation of sub‐targets), file format abstractions, and encourages reproducible and efficient analyses. It’s something like GNU Make for R, but more integrated. Skipping computation for up-to-date targets so that unchanged parts of the workflow are not recomputed. Targets can represent files or R objects, and tracking file changes etc is incorporated. -
8
WorkflowEngine.NET
WorkflowEngine.NET - component that adds workflow in your application
WorkflowEngine.NET is a flexible workflow engine for .NET applications that supports visual process design and dynamic execution of business logic. It enables developers to model complex workflows with conditions, branching, and state transitions. The engine is highly customizable and can be embedded into any .NET project to automate tasks and decision-making. -
9
ggraph
Grammar of Graph Graphics
ggraph adapts the Grammar of Graphics from ggplot2 for network and graph visualizations. It integrates with tidygraph/igraph data structures, providing a wide range of geoms, layouts (e.g. hive plots, circle packing), and layering methods tailored to hierarchical or relational data. -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
10
Weft
Task management, but AI agents do your tasks
...It runs entirely on Cloudflare’s platform using Workers, Durable Objects, and Workflows, enabling scalable and persistent task state with minimal backend overhead. Users can set up parallel agents to handle multiple tasks at once and even schedule recurring jobs that trigger daily or weekly to keep workflows on track. Notifications inform the user when tasks are completed or when agent approvals are required, keeping oversight within reach. -
11
ParallelStencil.jl
Package for writing high-level code for parallel stencil computations
ParallelStencil empowers domain scientists to write architecture-agnostic high-level code for parallel high-performance stencil computations on GPUs and CPUs. Performance similar to CUDA C / HIP can be achieved, which is typically a large improvement over the performance reached when using only CUDA.jl or AMDGPU.jl GPU Array programming. For example, a 2-D shallow ice solver presented at JuliaCon 2020 [1] achieved a nearly 20 times better performance than a corresponding GPU Array programming implementation; in absolute terms, it reached 70% of the theoretical upper performance bound of the used Nvidia P100 GPU, as defined by the effective throughput metric, T_eff. ... -
12
PartitionedArrays.jl
Vectors and sparse matrices partitioned into pieces
This package provides distributed (a.k.a. partitioned) vectors and sparse matrices in Julia. See the documentation for further details. -
13
DataChain
AI-data warehouse to enrich, transform and analyze unstructured data
Datachain enables multimodal API calls and local AI inferences to run in parallel over many samples as chained operations. The resulting datasets can be saved, versioned, and sent directly to PyTorch and TensorFlow for training. Datachain can persist features of Python objects returned by AI models, and enables vectorized analytical operations over them. The typical use cases are data curation, LLM analytics and validation, image segmentation, pose detection, and GenAI alignment. ... -
14
Tillywork
Opensource work management solution
Tillywork is a workflow automation and job scheduling system built on top of PostgreSQL. It’s designed for executing complex job chains with dependency management and error handling. Tillywork leverages SQL to define workflows, making it well-suited for data engineers and backend teams who want fine-grained control without adding a new runtime. -
15
XCharts
A charting and data visualization library for Unity
...Visual configuration of parameters, real-time preview of effects, and pure code drawing without additional resources. Support ten built-in charts such as line chart, column chart, pie chart, radar chart, scatter chart, heat map, ring chart, candlestick chart, polar coordinate, parallel coordinate and so on. Supports 3D column charts, funnel charts, pyramids, dashboards, water level charts, pictographic column charts, Gantt charts, rectangular tree charts and other extended charts. Line graphs such as line graphs, curve graphs, area graphs, and stepped line graphs are supported. -
16
XGBoost
Scalable and Flexible Gradient Boosting
...It supports regression, classification, ranking and user defined objectives, and runs on all major operating systems and cloud platforms. XGBoost works by implementing machine learning algorithms under the Gradient Boosting framework. It also offers parallel tree boosting (GBDT, GBRT or GBM) that can quickly and accurately solve many data science problems. XGBoost can be used for Python, Java, Scala, R, C++ and more. It can run on a single machine, Hadoop, Spark, Dask, Flink and most other distributed environments, and is capable of solving problems beyond billions of examples. -
17
nextflow
A DSL for data-driven computational pipelines
Nextflow is a powerful workflow orchestration tool designed for the development and execution of data-intensive pipelines, especially in the field of bioinformatics. It enables reproducible and portable workflows that can run seamlessly across different environments including local, HPC clusters, and cloud platforms. With support for containers and software package managers, Nextflow makes it easy to define complex data processes using a concise DSL and manage dependencies efficiently. -
18
The Julia Programming Language
High-level, high-performance dynamic language for technical computing
Julia is a fast, open source high-performance dynamic language for technical computing. It can be used for data visualization and plotting, deep learning, machine learning, scientific computing, parallel computing and so much more. Having a high level syntax, Julia is easy to use for programmers of every level and background. Julia has more than 2,800 community-registered packages including various mathematical libraries, data manipulation tools, and packages for general purpose computing. Libraries from Python, R, C/Fortran, C++, and Java can also be used. -
19
TIGRE
TIGRE: Tomographic Iterative GPU-based Reconstruction Toolbox
TIGRE is an open-source toolbox for fast and accurate 3D tomographic reconstruction for any geometry. Its focus is on iterative algorithms for improved image quality that have all been optimized to run on GPUs (including multi-GPUs) for improved speed. It combines the higher-level abstraction of MATLAB or Python with the performance of CUDA at a lower level in order to make it both fast and easy to use. TIGRE is free to download and distribute: use it, modify it, add to it, and share it. Our... -
20
go-streams
A lightweight stream processing library for Go
...In computing, a pipeline, also known as a data pipeline, is a set of data processing elements connected in series, where the output of one element is the input of the next one. The elements of a pipeline are often executed in parallel or in time-sliced fashion. Some amount of buffer storage is often inserted between elements. -
21
OptScale
FinOps and MLOps platform to run ML/AI and regular cloud workloads
Run ML/AI or any type of workload with optimal performance and infrastructure cost. OptScale allows ML teams to multiply the number of ML/AI experiments running in parallel while efficiently managing and minimizing costs associated with cloud and infrastructure resources. OptScale MLOps capabilities include ML model leaderboards, performance bottleneck identification and optimization, bulk run of ML/AI experiments, experiment tracking, and more. The solution enables ML/AI engineers to run automated experiments based on datasets and hyperparameter conditions within the defined infrastructure budget. ... -
22
Gradle Docker Compose Plugin
Simplifies usage of Docker Compose for integration testing
The Gradle Docker Compose Plugin by Avast integrates Docker Compose lifecycle management into Gradle builds. It allows developers to define and manage Docker containers required for integration testing or local development directly from their Gradle build scripts. This plugin automates the startup and shutdown of services, supports container health checks, and enables tight integration between application code and containerized services, enhancing reproducibility and automation in... -
23
Lithops
A multi-cloud framework for big data analytics
...It abstracts cloud providers like IBM Cloud, AWS, Azure, and Google Cloud into a unified interface and turns your Python functions into scalable, event-driven workloads. Lithops is ideal for data processing, ML inference, and embarrassingly parallel workloads, giving you the power of FaaS (Function-as-a-Service) without vendor lock-in. It also supports hybrid cloud setups, object storage access, and simple integration with Jupyter notebooks. -
24
better-all
Better Promise.all with automatic dependency optimization
better-all is a TypeScript library that reinvents the familiar Promise.all construct by automatically analyzing and optimizing dependency graphs between asynchronous tasks, enabling maximal parallelization without manual orchestration. It addresses a common limitation where developers must manually refactor their promise chains to achieve efficient concurrency when some tasks depend on others, which can be error-prone and hard to maintain. With an object-based API, each task is declared as... -
25
Marl
A hybrid thread / fiber task scheduler written in C++ 11
...The runtime is portable across platforms and integrates cleanly with real-time systems that must minimize latency jitter. Graphics, simulation, and media pipelines use marl to turn long serial phases into parallel stages without rewriting everything around coroutines.
