Search Results for "distributed storage"

Zinnia is a runtime for Filecoin Station modules. It provides a sandboxed environment to execute untrusted code on consumer-grade computers. Zinnia is a sandboxed and resource-limited runtime for distributed workers. This crate provides the zinnia executable to run modules locally, e.g. while developing.

Freenet Core is the backbone of the Freenet Project, a peer-to-peer platform for censorship-resistant, anonymous publishing and communication. It is designed to provide strong privacy by routing requests through multiple nodes using a "darknet" architecture where users connect only to trusted peers. Data is stored in a distributed manner and automatically replicated based on demand. Freenet is optimized for users who want to securely share files, host anonymous websites (known as...

Daft is a framework for ETL, analytics and ML/AI at scale. Its familiar Python Dataframe API is built to outperform Spark in performance and ease of use. Daft plugs directly into your ML/AI stack through efficient zero-copy integrations with essential Python libraries such as Pytorch and Ray. It also allows requesting GPUs as a resource for running models. Daft runs locally with a lightweight multithreaded backend. When your local machine is no longer sufficient, it scales seamlessly to run...

...Built in Rust, the system focuses on high performance, scalability, and efficient data processing for analytical queries. It is designed with a separation of compute and storage, allowing compute nodes to scale independently while storing data in object storage systems. This architecture enables cost-efficient storage and elastic scaling for workloads that involve large datasets and complex queries. Databend provides a unified engine capable of handling analytics, vector search, and full-text search within a single platform. ...

Linera Protocol is a blockchain or distributed ledger architecture designed for scalable and composable execution across shared state shards. It emphasizes linearizability, causal consistency, and determinism by structuring cross-domain interactions through explicit protocols and asynchronous messaging. Each domain (shard) handles its own commands and state transparently; inter-domain operations rely on well-defined messaging layers and proofs to preserve consistency without central...

Aurae is on a mission to be the most loved and effective way of managing workloads on a node. Our hope is that by bringing a better set of controls to a node, we can unlock brilliant higher-order distributed systems in the future. Aurae deploys a memory-safe 1 runtime daemon, process manager, and PID-1 initialization system to remotely schedule processes, containers, and virtual machines as well as set node configurations (e.g., networking storage). Through system proportioning and enterprise workload isolation techniques, the Aurae open-source project can complement higher-order schedulers and control planes (such as Kubernetes) as Aurae supports the usage of multi-tenant workloads and enterprise identities all the way down to the socket layer.