Search Results for "distributed storage"
Sort By:
Showing 217 open source projects for "distributed storage"
View related business solutions-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
1
Cloud Storage FUSE
A user-space file system for interacting with Google Cloud Storage
Cloud Storage FUSE is an open-source user-space file system adapter that allows Google Cloud Storage buckets to be mounted and accessed as if they were local file systems on a machine. This approach enables applications to interact with cloud storage using standard file system semantics, eliminating the need to rewrite code to use object storage APIs directly. -
2
Spacedrive
Spacedrive is an open source cross-platform file explorer
...For independent creatives, hoarders ,and those who want to own their digital footprint, Spacedrive provides a free file management experience like no other. A VDFS (virtual distributed filesystem) is a filesystem designed to work across a variety of storage layers. -
3
Zipkin
Distributed tracing system to gather timing data
Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. Some interesting data will be summarized for you, such as the percentage of time spent in a service, and whether or not operations... -
4
SeaweedFS
Distributed storage system for blobs, objects, files, and data lake
SeaweedFS is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV. SeaweedFS is an independent Apache-licensed open source project with its ongoing development made possible because of the community. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
Longhorn
Cloud-Native distributed block storage for Kubernetes
Historically, adding replicated storage to Kubernetes clusters has always been difficult, thus resulting in many non-cloud-hosted Kubernetes clusters not supporting persistent storage. Longhorn is the solution to this. Longhorn provides highly available, persistent storage for Kubernetes. It is lightweight, simplified, reliable and powerful. It’s easy to deploy and upgrade, cloud-native and best of all, completely free and open source. Longhorn has built-in incremental snapshot and backup... -
6
Tendis
Tendis is a high-performance distributed storage system
A high-performance, persistent key-value store developed by Tencent, combining features of Redis with LSM-tree storage for durability. -
7
PolarDB-X
PolarDB-X is a cloud native distributed SQL Database
PolarDB-X is a cloud-native distributed SQL database designed to handle high concurrency, massive storage, and complex querying scenarios. It features a shared-nothing architecture that decouples computing from storage, providing scalability and flexibility for various applications. -
8
ShardingSphere
Distributed database ecosphere
Apache ShardingSphere is an open-source ecosystem consisted of a set of distributed database solutions, including 3 independent products, JDBC, Proxy & Sidecar (Planning). They all provide functions of data scale out, distributed transaction and distributed governance, applicable in a variety of situations such as Java isomorphism, heterogeneous language and cloud native. Apache ShardingSphere aiming at reasonably making full use of the computation and storage capacity of existed database in distributed system, rather than a totally new database. ... -
9
PolarDB for PostgreSQL
A cloud-native database based on PostgreSQL developed by Alibaba Cloud
PolarDB for PostgreSQL is Alibaba Cloud's cloud-native, distributed version of PostgreSQL designed for high availability, scalability, and performance. It enhances standard PostgreSQL with features like shared storage, compute-storage separation, and parallel processing. PolarDB supports cloud-native workloads, offering enterprise-grade capabilities while maintaining PostgreSQL compatibility. -
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
10
IPFS Cluster
Pinset orchestration for IPFS
IPFS Cluster provides data orchestration across a swarm of IPFS daemons by allocating, replicating and tracking a global pinset distributed among multiple peers. IPFS has given the users the power of content-addressed storage. The permanent web requires, however, a data redundancy and availability solution that does not compromise on the distributed nature of the IPFS Network. IPFS Cluster is a distributed application that works as a sidecar to IPFS peers, maintaining a global cluster pinset and intelligently allocating its items to the IPFS peers. ... -
11
Citus
Distributed PostgreSQL as an extension
Distributed query engine routes and parallelizes SELECT, DML, and other operations on distributed tables across the cluster. Columnar storage compresses data, speeds up scans, and supports fast projections, both on regular and distributed tables. You can use these Citus superpowers to make your Postgres database scale-out ready on a single Citus node. -
12
HDF5
Official HDF5® Library Repository
HDF5 (Hierarchical Data Format v5) is a widely-used data management library and file format for storing large and complex scientific data sets efficiently. -
13
ScalarDB
Universal HTAP Engine
ScalarDB is an open-source, multi-storage transactional database library that adds ACID-compliant transactions to various NoSQL and key-value databases like Cassandra, DynamoDB, and CosmosDB. -
14
Diffuse
A music player that connects to your cloud/distributed storage
A music player that connects to your cloud/distributed storage, in the form of a static, serverless, web application. Diffuse is a static web application, which means it's just HTML, CSS, and Javascript. No REST API, database, or anything backend-related is involved. The app uses a hash (aka. fragment-based) routing system, so you don't need any special server rules for routing. You can download a pre-build web-only version of Diffuse on the releases page. -
15
Mooncake
Mooncake is the serving platform for Kimi
...The platform was originally developed as part of the serving infrastructure for the Kimi large language model system. Its architecture centers on a high-performance transfer engine that provides unified data transfer across different storage and networking technologies. This engine enables efficient movement of tensors and model data across heterogeneous environments such as GPU memory, system memory, and distributed storage systems. Mooncake also introduces distributed key-value cache storage that allows inference systems to reuse previously computed attention states, significantly improving throughput in large-scale deployments. ... -
16
Irmin
Irmin is a distributed database
Irmin is an OCaml library for building mergeable, branchable distributed data stores. A distributed database built on the same principles as Git. Backup and restore your data at any point in time. You can use Irmin on top of your own storage layer. Automatic (de)serialization for custom data types. Runs anywhere from Linux to web browsers and Xen unikernels. Bi-directional compatibility with the Git on-disk format. -
17
Jaeger
Monitor and troubleshoot transactions in complex distributed systems
...It is used for monitoring and troubleshooting microservices-based distributed systems. OpenTracing compatible data model and instrumentation libraries include Go, Java, Node, Python, C++ and C#. Jaeger uses consistent upfront sampling with individual per service/endpoint probabilities and it has multiple storage backends: Cassandra, Elasticsearch, memory. -
18
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
19
Vald
Vald. A Highly Scalable Distributed Vector Search Engine
...Vald is easy to use, feature-rich and highly customizable as you needed. Usually, the graph requires locking during indexing, which causes stop-the-world. But Vald uses distributed index graphs so it continues to work during indexing. Vald implements it's own highly customizable Ingress/Egress filter. Which can be configured to fit the gRPC interface. Horizontal scalable on memory and cpu for your demand. Vald supports to auto backup feature using Object Storage or Persistent Volume which enables disaster recovery. -
20
Rook
Storage Orchestration for Kubernetes
Rook turns distributed storage systems into self-managing, self-scaling, self-healing storage services. It automates the tasks of a storage administrator: deployment, bootstrapping, configuration, provisioning, scaling, upgrading, migration, disaster recovery, monitoring, and resource management. Rook orchestrates the Ceph storage solution, with a specialized Kubernetes Operator to automate management. -
21
Apache HBase
Get random, realtime read/write access to your Big Data
...This project's goal is the hosting of very large tables, billions of rows X millions of columns, atop clusters of commodity hardware. Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable. A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, Apache HBase provides Bigtable-like capabilities on top of Hadoop and HDFS. Thrift gateway and a REST-ful Web service that supports XML, Protobuf, and binary data encoding options. ... -
22
huey
A little task queue for python
huey is a lightweight task queue for Python applications. It gives developers a clean API for running background jobs outside the main request or execution flow. The project supports several storage backends, including Redis, Valkey, Redict, SQLite, the file system, and in-memory storage. It can execute tasks with processes, threads, or greenlets, which makes it adaptable to different workloads. Huey also supports scheduled tasks, recurring tasks, retries, task priorities, result storage, expiration, locking, rate limits, timeouts, pipelines, groups, and chords. ... -
23
Activiti
Light-weight workflow and business process management pltaform
...Inmutable, scalable & pain free Process & Decision Runtimes designed to integrate with your cloud native infrastructure. Scalable, storage independent and extensible audit service. Scalable, storage independent and extensible query service. Simplified system to system interactions that can scale in distributed environments. Distributed & Scalable application aggregation layer. Cloud ready secure WebSocket and subscription handling as part of GraphQL integration. -
24
OpenEBS
Leading Open Source Container Attached Storage
OpenEBS helps Developers and Platform SREs easily deploy Kubernetes Stateful Workloads that require fast and highly reliable container-attached storage. OpenEBS turns any storage available on the Kubernetes worker nodes into local or distributed Kubernetes Persistent Volumes. OpenEBS is Kubernetes native Container Attached Storage solution that makes it possible for Stateful applications to easily access Dynamic Local PVs or Replicated PVs. By using the Container Attached Storage pattern users report lower costs, easier management, and more control for their teams. ... -
25
ConcourseDB
Distributed database warehouse for transactions, search and analytics
ConcourseDB is a distributed, self-tuning database designed for real-time applications, offering strong consistency and ACID compliance without requiring complex configurations. It provides dynamic schema support and automatic indexing.
