Search Results for "distributed storage"
Sort By:
Showing 278 open source projects for "distributed storage"
View related business solutions-
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
1
Cloud Storage FUSE
A user-space file system for interacting with Google Cloud Storage
Cloud Storage FUSE is an open-source user-space file system adapter that allows Google Cloud Storage buckets to be mounted and accessed as if they were local file systems on a machine. This approach enables applications to interact with cloud storage using standard file system semantics, eliminating the need to rewrite code to use object storage APIs directly. -
2
Spacedrive
Spacedrive is an open source cross-platform file explorer
...For independent creatives, hoarders ,and those who want to own their digital footprint, Spacedrive provides a free file management experience like no other. A VDFS (virtual distributed filesystem) is a filesystem designed to work across a variety of storage layers. -
3
Zipkin
Distributed tracing system to gather timing data
Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. Some interesting data will be summarized for you, such as the percentage of time spent in a service, and whether or not operations... -
4
SeaweedFS
Distributed storage system for blobs, objects, files, and data lake
SeaweedFS is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV. SeaweedFS is an independent Apache-licensed open source project with its ongoing development made possible because of the community. ... -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
Longhorn
Cloud-Native distributed block storage for Kubernetes
Historically, adding replicated storage to Kubernetes clusters has always been difficult, thus resulting in many non-cloud-hosted Kubernetes clusters not supporting persistent storage. Longhorn is the solution to this. Longhorn provides highly available, persistent storage for Kubernetes. It is lightweight, simplified, reliable and powerful. It’s easy to deploy and upgrade, cloud-native and best of all, completely free and open source. Longhorn has built-in incremental snapshot and backup... -
6
Hazelcast
Open-source distributed computation and storage platform
Hazelcast is a streaming and memory-first application platform for fast, stateful, data-intensive workloads on-premises, at the edge or as a fully managed cloud service. Hazelcast is a distributed computation and storage platform for consistently low-latency querying, aggregation and stateful computation against event streams and traditional data sources. It allows you to quickly build resource-efficient, real-time applications. You can deploy it at any scale from small edge devices to a large cluster of cloud instances. ... -
7
Tendis
Tendis is a high-performance distributed storage system
A high-performance, persistent key-value store developed by Tencent, combining features of Redis with LSM-tree storage for durability. -
8
PolarDB-X
PolarDB-X is a cloud native distributed SQL Database
PolarDB-X is a cloud-native distributed SQL database designed to handle high concurrency, massive storage, and complex querying scenarios. It features a shared-nothing architecture that decouples computing from storage, providing scalability and flexibility for various applications. -
9
ShardingSphere
Distributed database ecosphere
Apache ShardingSphere is an open-source ecosystem consisted of a set of distributed database solutions, including 3 independent products, JDBC, Proxy & Sidecar (Planning). They all provide functions of data scale out, distributed transaction and distributed governance, applicable in a variety of situations such as Java isomorphism, heterogeneous language and cloud native. Apache ShardingSphere aiming at reasonably making full use of the computation and storage capacity of existed database in distributed system, rather than a totally new database. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
PolarDB for PostgreSQL
A cloud-native database based on PostgreSQL developed by Alibaba Cloud
PolarDB for PostgreSQL is Alibaba Cloud's cloud-native, distributed version of PostgreSQL designed for high availability, scalability, and performance. It enhances standard PostgreSQL with features like shared storage, compute-storage separation, and parallel processing. PolarDB supports cloud-native workloads, offering enterprise-grade capabilities while maintaining PostgreSQL compatibility. -
11
IPFS Cluster
Pinset orchestration for IPFS
IPFS Cluster provides data orchestration across a swarm of IPFS daemons by allocating, replicating and tracking a global pinset distributed among multiple peers. IPFS has given the users the power of content-addressed storage. The permanent web requires, however, a data redundancy and availability solution that does not compromise on the distributed nature of the IPFS Network. IPFS Cluster is a distributed application that works as a sidecar to IPFS peers, maintaining a global cluster pinset and intelligently allocating its items to the IPFS peers. ... -
12
Citus
Distributed PostgreSQL as an extension
Distributed query engine routes and parallelizes SELECT, DML, and other operations on distributed tables across the cluster. Columnar storage compresses data, speeds up scans, and supports fast projections, both on regular and distributed tables. You can use these Citus superpowers to make your Postgres database scale-out ready on a single Citus node. -
13
Jaeger
Monitor and troubleshoot transactions in complex distributed systems
...It is used for monitoring and troubleshooting microservices-based distributed systems. OpenTracing compatible data model and instrumentation libraries include Go, Java, Node, Python, C++ and C#. Jaeger uses consistent upfront sampling with individual per service/endpoint probabilities and it has multiple storage backends: Cassandra, Elasticsearch, memory. -
14
HDF5
Official HDF5® Library Repository
HDF5 (Hierarchical Data Format v5) is a widely-used data management library and file format for storing large and complex scientific data sets efficiently. -
15
ScalarDB
Universal HTAP Engine
ScalarDB is an open-source, multi-storage transactional database library that adds ACID-compliant transactions to various NoSQL and key-value databases like Cassandra, DynamoDB, and CosmosDB. -
16
Diffuse
A music player that connects to your cloud/distributed storage
A music player that connects to your cloud/distributed storage, in the form of a static, serverless, web application. Diffuse is a static web application, which means it's just HTML, CSS, and Javascript. No REST API, database, or anything backend-related is involved. The app uses a hash (aka. fragment-based) routing system, so you don't need any special server rules for routing. You can download a pre-build web-only version of Diffuse on the releases page. -
17
Irmin
Irmin is a distributed database
Irmin is an OCaml library for building mergeable, branchable distributed data stores. A distributed database built on the same principles as Git. Backup and restore your data at any point in time. You can use Irmin on top of your own storage layer. Automatic (de)serialization for custom data types. Runs anywhere from Linux to web browsers and Xen unikernels. Bi-directional compatibility with the Git on-disk format. -
18
Mooncake
Mooncake is the serving platform for Kimi
...The platform was originally developed as part of the serving infrastructure for the Kimi large language model system. Its architecture centers on a high-performance transfer engine that provides unified data transfer across different storage and networking technologies. This engine enables efficient movement of tensors and model data across heterogeneous environments such as GPU memory, system memory, and distributed storage systems. Mooncake also introduces distributed key-value cache storage that allows inference systems to reuse previously computed attention states, significantly improving throughput in large-scale deployments. ... -
19
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
20
Rook
Storage Orchestration for Kubernetes
Rook turns distributed storage systems into self-managing, self-scaling, self-healing storage services. It automates the tasks of a storage administrator: deployment, bootstrapping, configuration, provisioning, scaling, upgrading, migration, disaster recovery, monitoring, and resource management. Rook orchestrates the Ceph storage solution, with a specialized Kubernetes Operator to automate management. -
21
Vald
Vald. A Highly Scalable Distributed Vector Search Engine
...Vald is easy to use, feature-rich and highly customizable as you needed. Usually, the graph requires locking during indexing, which causes stop-the-world. But Vald uses distributed index graphs so it continues to work during indexing. Vald implements it's own highly customizable Ingress/Egress filter. Which can be configured to fit the gRPC interface. Horizontal scalable on memory and cpu for your demand. Vald supports to auto backup feature using Object Storage or Persistent Volume which enables disaster recovery. -
22
AgentENV
Distributed platform for running agent environments at scale
AgentENV is a distributed platform for running large numbers of isolated AI-agent environments across one or more machines. It uses Firecracker microVMs to provide strong sandboxing while loading diverse OCI-compatible images on demand. Overlay-based storage and bounded local caching keep frequently used data close without requiring every image to fit on each host. -
23
huey
A little task queue for python
huey is a lightweight task queue for Python applications. It gives developers a clean API for running background jobs outside the main request or execution flow. The project supports several storage backends, including Redis, Valkey, Redict, SQLite, the file system, and in-memory storage. It can execute tasks with processes, threads, or greenlets, which makes it adaptable to different workloads. Huey also supports scheduled tasks, recurring tasks, retries, task priorities, result storage, expiration, locking, rate limits, timeouts, pipelines, groups, and chords. ... -
24
Riot search
Go Open Source, Distributed, Simple and efficient Search Engine
...Support calculation BM25 correlation. Support custom scoring field and scoring rules. Support add online, delete index. Support heartbeat. Support multiple persistent storage. Support distributed index and search. Can be achieved distributed index and search. Look at Word segmentation rules. -
25
OpenEBS
Leading Open Source Container Attached Storage
OpenEBS helps Developers and Platform SREs easily deploy Kubernetes Stateful Workloads that require fast and highly reliable container-attached storage. OpenEBS turns any storage available on the Kubernetes worker nodes into local or distributed Kubernetes Persistent Volumes. OpenEBS is Kubernetes native Container Attached Storage solution that makes it possible for Stateful applications to easily access Dynamic Local PVs or Replicated PVs. By using the Container Attached Storage pattern users report lower costs, easier management, and more control for their teams. ...
