Search Results for "distributed computing" - Page 2
Sort By:
Showing 1331 open source projects for "distributed computing"
View related business solutions-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
Data-Juicer
Data processing for and with foundation models
Data-Juicer is an open-source data processing and augmentation framework designed to enhance the quality and diversity of datasets for machine learning tasks. It includes a modular pipeline for scalable data transformation. -
2
FileTrees.jl
Parallel file processing made easy
...Files and subtrees in a file tree can have any value attached to them, you can map and reduce over these values, or combine them by merging or collapsing trees or subtrees. When computing lazy trees, these values are held in distributed memory and operated on in parallel. -
3
DL_POLY
General purpose classical molecular dynamics (MD) simulation software
DL_POLY is a general-purpose classical molecular dynamics simulation package developed at Daresbury Laboratory. It has evolved from older replicated-memory designs into a distributed-memory code suitable for modern parallel computing. The software can be built in serial form or with MPI for larger simulations. It is used for molecular modeling in chemistry, physics, materials science, and condensed-matter research. DL_POLY provides a mature simulation environment for studying atomic and molecular systems under classical force-field descriptions. ... -
4
Apache Sedona
Cluster computing framework for processing large-scale geospatial data
Apache Sedona™ is a cluster computing system for processing large-scale spatial data. Sedona extends existing cluster computing systems, such as Apache Spark and Apache Flink, with a set of out-of-the-box distributed Spatial Datasets and Spatial SQL that efficiently load, process, and analyze large-scale spatial data across machines. According to our benchmark and third-party research papers, Sedona runs 2X - 10X faster than other Spark-based geospatial data systems on computation-intensive query workloads. ... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
libSQL
libSQL is a fork of SQLite that is both Open Source
libSQL is an open-source, community-driven fork of SQLite maintained by Turso. It aims to modernize SQLite by optimizing for performance and availability, targeting distributed and low-latency applications. SQLite has solidified its place in modern technology stacks, embedded in nearly any computing device you can think of. Its open source nature and public domain availability make it a popular choice for modification to meet specific use cases. libSQL will always be able to ingest and write the SQLite file format. ... -
6
Ray
A unified framework for scalable computing
Modern workloads like deep learning and hyperparameter tuning are compute-intensive and require distributed or parallel execution. Ray makes it effortless to parallelize single machine code — go from a single CPU to multi-core, multi-GPU or multi-node with minimal code changes. Accelerate your PyTorch and Tensorflow workload with a more resource-efficient and flexible distributed execution framework powered by Ray. Accelerate your hyperparameter search workloads with Ray Tune. Find the best... -
7
Xtuner
A Next-Generation Training Engine Built for Ultra-Large MoE Models
Xtuner is a large-scale training engine designed for efficient training and fine-tuning of modern large language models, particularly mixture-of-experts architectures. The framework focuses on enabling scalable training for extremely large models while maintaining efficiency across distributed computing environments. Unlike traditional 3D parallel training strategies, XTuner introduces optimized parallelism techniques that simplify scaling and reduce system complexity when training massive models. The engine supports training models with hundreds of billions of parameters and enables long-context training with sequence lengths reaching tens of thousands of tokens. ... -
8
Constellation
Constellation is the first Confidential Kubernetes
Constellation is a distributed confidential computing platform developed by Edgeless Systems. It allows developers to run Kubernetes-native applications in secure enclaves across multiple machines, ensuring end-to-end encryption and trusted execution for workloads. Built on top of Kubernetes and using technologies like Intel SGX and Gramine, Constellation guarantees that not even infrastructure operators can access data or code, making it ideal for privacy-sensitive workloads and multi-party computation scenarios. -
9
Neboa
Type-safe NoSQL with Node & SQLite
Neboa is a lightweight, decentralized NoSQL database designed for distributed applications. It offers peer-to-peer synchronization and ensures data integrity across multiple nodes without relying on centralized servers, making it ideal for edge computing and offline-first applications. -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
10
Matrix
Multi-Agent daTa geneRation Infra and eXperimentation framework
Matrix is a distributed, large-scale engine for multi-agent synthetic data generation and experiments: it provides the infrastructure to run thousands of “agentic” workflows concurrently (e.g. multiple LLMs interacting, reasoning, generating content, data-processing pipelines) by leveraging distributed computing (like Ray + cluster management). The idea is to treat data generation as a “data-to-data” transformation: each input item defines a task, and the runtime orchestrates asynchronous, peer-to-peer agent workflows, avoiding global synchronization bottlenecks. ... -
11
EvoTorch
Advanced evolutionary computation library built on top of PyTorch
EvoTorch is an evolutionary optimization framework built on top of PyTorch, developed by NNAISENSE. It is designed for large-scale optimization problems, particularly those that require evolutionary algorithms rather than gradient-based methods. -
12
Micronaut
Micronaut Application Framework
...With Micronaut you can build message-driven applications, command-line applications, HTTP servers, and more whilst for Microservices in particular Micronaut also provides distributed configuration. This is achieved by pre-computing the framework infrastructure at compilation time which reduces the logic required at runtime for the application to work. Compatible with Java, Groovy, and Kotlin, with Scala on the roadmap. -
13
Software to support the development of distributed data acquisition and analysis systems, used primarily in the implementation of instrumentation for pulsar astronomy.
-
14
Apache Seata
High-performance, open source distributed transaction solution
Seata is a distributed transaction solution for microservices that provides consistent, cross-service commits without forcing every team to adopt the same persistence model. Its architecture separates responsibilities into a global coordinator and per-service participants, so business services remain decoupled while transactions are orchestrated centrally. Multiple modes are supported—AT (automatic, SQL-based with undo logs), TCC (try-confirm-cancel), Saga (long-running compensation), and... -
15
linuxptp
PTP IEEE 1588 stack for Linux
This project is an implementation of the Precision Time Protocol (PTP) according to IEEE standard 1588 for Linux. -
16
openQRM - Cloud Computing Platform
Get latest Edition here: http://www.openqrm-enterprise.com.
openQRM is a web-based open source datacenter management and hybrid cloud computing platform that integrates flexibly with existing components in enterprise data centers. Releases available at https://github.com/openQRM/openqrm-community. Please visit http://www.openqrm-enterprise.com for latest 5.3 free Community Release. Includes important security updates, bugfixes and enhancements especially for KVM and Cloud plugin. openQRM abstracts Virtualization and supports the following... -
17
tsuru
Open source and extensible Platform as a Service (PaaS)
...Let your developers code and understand the business instead of solving infrastructure problems or handling large configuration files. We built the platform as a service atop of battle-tested technologies from Cloud Native Computing Foundation stack. Manage your distributed apps in many kubernetes clusters/regions with a single point of control. Tsuru is an open source project and, as such, we welcome contributions. Feel free to report or fix bugs, contribute to the documentation, or just give your opinion about the software. -
18
TDengine
Open-source time-series database with high-performance and scalability
...TDengine’s innovative design and purpose-built storage engine outperforms other time-series databases for data ingestion, querying and data compression while significantly reducing storage and computing costs. TDengine’s native distributed architecture powers out-of-the-box scalability and high availability. Nodes can be added through simple configuration to achieve greater data processing power. In addition, this feature is open source. TDengine uses SQL as the query language, thereby reducing learning and migration costs, while adding SQL extensions to handle time-series data better, and supporting convenient and flexible schemaless data ingestion. -
19
HolmesGPT
CNCF Sandbox Project
HolmesGPT is an open-source AI agent designed to help DevOps and site reliability engineering teams diagnose and resolve production incidents. The system aggregates signals from observability tools such as logs, metrics, alerts, and distributed traces, then analyzes them using large language models to identify potential root causes. Rather than requiring engineers to manually correlate large volumes of monitoring data, HolmesGPT automatically synthesizes evidence and presents explanations in natural language. The project is developed by Robusta and has been accepted as a Cloud Native Computing Foundation Sandbox project, highlighting its relevance to the cloud-native ecosystem. ... -
20
Papers We Love
Papers from the computer science community to read and discuss
Papers We Love (PWL) is a global open source community dedicated to reading, discussing, and sharing influential computer science research papers. The repository serves as a curated directory of academic papers that have shaped the field of computing, providing a centralized location for documents that were previously scattered across various online sources. While licensing restrictions prevent hosting all papers directly, PWL offers links to their original sources and clearly marks hosted copies with an emoji. The community encourages participation through local meetups, where members gather to discuss and analyze key works spanning topics such as programming languages, distributed systems, and software engineering. ... -
21
SurrealDB
A scalable, distributed, collaborative, document-graph database
With an SQL-style query language, real-time queries with highly-efficient related data retrieval, advanced security permissions for multi-tenant access, and support for performant analytical workloads, SurrealDB is the next generation serverless database. SurrealDB is the ultimate cloud database for tomorrow's applications. SurrealDB is an innovative NewSQL cloud database, suitable for serverless applications, jamstack applications, single-page applications, and traditional applications. It... -
22
gRPC-Go
The Go language implementation of gRPC. HTTP/2 based RPC
...It can efficiently connect services in and across data centers with pluggable support for load balancing, tracing, health checking and authentication. It is also applicable in last mile of distributed computing to connect devices, mobile applications and browsers to backend services. Define your service using Protocol Buffers, a powerful binary serialization toolset and language. Install runtime and dev environments with a single line and also scale to millions of RPCs per second with the framework. Automatically generate idiomatic client and server stubs for your service in a variety of languages and platforms. ... -
23
OSMO
The developer-first platform for scaling complex Physical AI workloads
OSMO is a developer-first orchestration platform designed to scale complex physical AI workflows across heterogeneous computing environments, including cloud GPUs, simulation clusters, and edge devices. It was originally built internally at NVIDIA to support robotics and embodied AI systems, where workflows span multiple stages such as data generation, training, simulation, and hardware testing. The platform addresses what NVIDIA refers to as the “three computer problem” by unifying these... -
24
polynote
A better notebook for Scala (and more)
Polynote is an innovative polyglot notebook environment that improves on traditional interactive computing tools by enabling multi-language notebooks where users can mix languages like Scala, Python, SQL, and more within a single document while sharing variables and definitions seamlessly across those languages. Designed to address shortcomings in classic notebook solutions, it blends features familiar from IDEs — such as smart autocomplete, parameter hints, and better runtime insights —... -
25
Angel
A Flexible and Powerful Parameter Server for large-scale ML
Angel is a high-performance distributed machine learning and graph computing platform based on the philosophy of Parameter Server. It is tuned for performance with big data from Tencent and has a wide range of applicability and stability, demonstrating an increasing advantage in handling higher-dimension models. Angel is jointly developed by Tencent and Peking University, taking account of both high availability in industry and innovation in academia.
