Showing 25 open source projects for "data"

View related business solutions
  • Fully Managed MySQL, PostgreSQL, and SQL Server Icon
    Fully Managed MySQL, PostgreSQL, and SQL Server

    Automatic backups, patching, replication, and failover. Focus on your app, not your database.

    Cloud SQL handles your database ops end to end, so you can focus on your app.
    Try Free
  • $300 Free Credits for Your Google Cloud Projects Icon
    $300 Free Credits for Your Google Cloud Projects

    Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

    Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
    Start Free Trial
  • 1
    Project Lotus

    Project Lotus

    Reference implementation of the Filecoin protocol, written in Go

    ...This website contains all the information you need to spin up a Lotus node, become a Filecoin storage provider, or just tinker around with the Filecoin network! Filecoin is a network of computers that allows you to store your data online. But while online storage services aren't anything new, Filecoin is different. It doesn't use centralized servers to store your data or rely on aggressive analytics tactics to make a profit and pay its shareholders. You can find out more about Filecoin and how it works over at docs.filecoin.io.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 2
    DefraDB

    DefraDB

    DefraDB is a Peer-to-Peer Edge Database

    DefraDB is a Peer-to-Peer Edge Database. It's the core data storage system for the Source Network Ecosystem, built with IPFS/IPLD, LibP2P, CRDTs, and Semantic web3 properties. DefraDB is a user-centric database that prioritizes data ownership, personal privacy, and information security. Its data model, powered by the convergence of MerkleCRDTs and the content-addressability of IPLD, enables a multi-write-master architecture.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    IPFS Cluster

    IPFS Cluster

    Pinset orchestration for IPFS

    IPFS Cluster provides data orchestration across a swarm of IPFS daemons by allocating, replicating and tracking a global pinset distributed among multiple peers. IPFS has given the users the power of content-addressed storage. The permanent web requires, however, a data redundancy and availability solution that does not compromise on the distributed nature of the IPFS Network.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    ownCloud Infinite Scale

    ownCloud Infinite Scale

    ownCloud Infinite Scale Stack

    ...Built with a microservices architecture in Go, it replaces the traditional monolithic server with a distributed system optimized for containerized and hybrid cloud environments. The platform focuses on providing a unified data access layer that can connect multiple storage backends while maintaining strong control over file sharing and governance. It enables real-time collaboration through web office integrations and supports advanced administrative features such as custom roles, tagging, and full-text search. Because of its modular design, oCIS can be deployed efficiently in public, private, or hybrid infrastructures while reducing operational overhead.
    Downloads: 3 This Week
    Last Update:
    See Project
  • Host LLMs in Production With On-Demand GPUs Icon
    Host LLMs in Production With On-Demand GPUs

    NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

    Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
    Try Free
  • 5
    ipfs-check

    ipfs-check

    A tool for checking the accessibility of your data by IPFS peers

    A tool for checking the accessibility of your data by IPFS peers. go build will build the server binary in your local directory. go install will build and install the server binary in your global Go binary directory (e.g. ~/go/bin) There are web assets in the web that interact with the Go HTTP server that can be deployed however you deploy web assets. Maybe just deploy it on IPFS and reference it with DNSLink.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    qui

    qui

    A fast, single-binary qBittorrent web UI

    ...It also integrates advanced automation features that enable rule-based actions, allowing users to define conditions for downloading, organizing, or managing torrents automatically. A standout capability of qui is its cross-seeding functionality, which helps users maximize efficiency by matching and reusing existing data across different trackers. The interface is optimized for responsiveness even when handling large torrent libraries, ensuring smooth performance.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 7
    Hyperledger FireFly

    Hyperledger FireFly

    Hyperledger FireFly is the first open source Supernode

    Hyperledger FireFly is the first open source Supernode: a complete stack for enterprises to build and scale secure Web3 applications. The FireFly API for digital assets, data flows, and blockchain transactions makes it radically faster to build production-ready apps on popular chains and protocols. Hyperledger FireFly has a pluggable microservices architecture. Everything is pluggable, from the Blockchain technology, token ERC standards, and custom smart contracts, all the way to the event distribution layer and private database. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    IPFS Kubo

    IPFS Kubo

    An IPFS implementation in Go

    Kubo was the first IPFS implementation and is the most widely used one today. Implementing the Interplanetary Filesystem - the Web3 standard for content-addressing, interoperable with HTTP. Thus powered by IPLD's data models and the libp2p for network communication. Kubo is written in Go. IPFS is a global, versioned, peer-to-peer filesystem. It combines good ideas from previous systems such as Git, BitTorrent, Kademlia, SFS, and the Web. It is like a single BitTorrent swarm, exchanging git objects. IPFS provides an interface as simple as the HTTP web, but with permanence built-in. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    bifrost-gateway

    bifrost-gateway

    A lightweight IPFS Gateway daemon backed by a remote data store

    A lightweight IPFS Gateway daemon backed by a remote data store. bifrost-gateway provides a single binary daemon implementation of HTTP+Web Gateway Specs. All you need is a trustless gateway endpoint that supports verifiable response types. The minimum requirement is support for GET /ipfs/cid with application/vnd.ipld.raw (block by block).
    Downloads: 0 This Week
    Last Update:
    See Project
  • Train ML Models With SQL You Already Know Icon
    Train ML Models With SQL You Already Know

    BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

    Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
    Try Free
  • 10
    FileDAG Storage

    FileDAG Storage

    A distributed storage service built on the IPFS technology stack

    FileDAG Storage A distributed storage service built on the IPFS technology stack. Different from the official implementation of IPFS, we focus more on data management, data reliability, availability and fault tolerance, and clustering of storage nodes. The minimum storage unit of FileDAG Storage is dag, which is the data block. Files or objects are organized in a merkle-dag structure, and multiple files or objects may share some data blocks. The obvious benefit of this is to reduce redundant data, especially for multi-version systems. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Amplify

    Amplify

    Automatic enrichment, enhancement, and explanation of your data

    Amplify attaches afterburners to your data. Amplify explains metadata extraction, classification, tagging, and reporting. Eriches derivative data generation like thumbnails, previews, conversions, etc. Enhances batteries-included value-adds like data quality reports, image augmentation, OCR, translations, etc. Amplify leverages the decentralized compute provided by Bacalhau to magically enrich your data.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    EdgeUR

    EdgeUR

    Edge Gateway + Storage deal making using Delta

    Edge is currently under heavy development. Dedicated light node to upload and retrieve their CIDs. To do this, we decoupled the upload and retrieval aspect from the Estuary API node so we can create a node that can live on the "edge" closer to the customer. Dedicated node assignment for each customer. The customer or user can now launch an edge node and use it for both uploading to Estuary and retrieval using the same API keys issued from Estuary. Switches the upload protocol. The user still...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Estuary

    Estuary

    A custom IPFS/Filecoin node that makes it easy to pin IPFS content

    ...It is also important you understand how to protect your API key/secrets from bad actors and abuse. If this concept is foreign to you, you might be better off just using https://estuary.tech and storing data through our website.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    Myel pop

    Myel pop

    Run a point-of-presence within Myel

    Run a point-of-presence within Myel, the community-powered content delivery network. Our mission is to build a community powered content delivery network that is resilient, scalable, and peer-to-peer ↔️ to suit the long-term needs of Web3 applications. We're currently using Filecoin building blocks and are aspiring to make this library as interoperable as possible with existing Web3 backends such as IPFS. This library is still experimental so feel free to open an issue if you have any...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    IPFS Copy

    IPFS Copy

    Pin your existing IPFS files stored in Infura in 3 steps

    Migrate your IPFS data to Infura in 3 steps. ipfs-copy is a migration tool for both existing Infura IPFS users and new users currently self-hosting their data that want to migrate to the new, more reliable, performant Infura IPFS service with all the latest features.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    ipfs-pinner

    ipfs-pinner

    A toolkit helps upload files to IPFS pinning services

    ipfs-pinner is a toolkit to help upload files or specific content id to IPFS pinning services.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Qri CLI

    Qri CLI

    Organize, version, automate, and share datasets

    Because qri is global and content-addressed, adding data to qri also checks the entire network to see if someone has added it before. Since qri is focused solely on datasets, it can provide meaningful search results. Every change on qri is associated with a peer, creating an audit-able trail you can use to quickly see what has changed and who has changed it. All datasets on qri are automatically described at the time of ingest using a flexible schema that makes data naturally inter-operate. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    ipfs-pump

    ipfs-pump

    A tool to transfer data between IPFS nodes or storage

    ipfs-pump is a command line tool to copy data between IPFS nodes, cluster or storage.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    pcp - Peer Copy

    pcp - Peer Copy

    Command line peer-to-peer data transfer tool based on libp2p

    Command line peer-to-peer data transfer tool based on libp2p. There already exists a long list of file transfer tools, so why bother building another one? The problem I had with the existing tools is that they rely on a limited set of servers to orchestrate peer matching and data relaying which poses a centralization concern. Many of the usual centralization vs. decentralization arguments apply here, e.g. the servers are single points of failure, the service operator has the power over whom to serve and whom not, etc. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Multiverse

    Multiverse

    Decentralized Version Control System

    ...Multiverse builds on top of the libp2p and IPFS projects to provide a decentralized code-hosting network. Decentralized networks shift the power from service providers to the users in the form of data ownership. Data ownership and data portability are the two core factors that will drive innovation on the Multiverse network. Switching service providers is completely transparent as none of your data is trapped behind a walled garden.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    s3x

    s3x

    s3x is a minio gateway providing an S3 API powered by TemporalX

    s3x is an open-source gateway for github.com/minio/minio to work with TemporalX as an S3 gateway. It allows using IPFS from any application that currently uses S3, or minio, without needing to redesign your application architecture. It represents an incredible leap forward in usability for IPFS, and up until now no implementation of IPFS allowed you to use it, without needing to build your application specifically for IPFS. Additionally this means your S3 applications can leverage the...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    ipld-eml

    ipld-eml

    An RFC-5322 compatible email parser that stores data on IPFS

    ipld-eml is an RFC-5322 compliand IPLD object format for storing email messages, in both a space efficient, and time efficient manner. TemporalX is used as the interface into IPFS. Emails are converted into a protocol buffer object, before being stored onto IPFS. There are currently two methods for storing the IPLD objects:
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    go-textile

    go-textile

    Infrastructure for building composable apps and services on the IPFS

    Textile provides encrypted, recoverable, schema-based, and cross-application data storage built on IPFS and libp2p. We like to think of it as a decentralized data wallet with built-in protocols for sharing and recovery, or more simply, an open and programmable iCloud. Textile is still under heavy development and no part of it should be used before a thorough review of the underlying code and an understanding that APIs and protocols may change rapidly.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 24
    krab

    krab

    krab is an encrypted keystore for use with IPFS

    krab is a "semi secure" keystore that satisfies the IPFS keystore interface, allowing it to be used natively with many existing IPFS implementations, and tools. It stores keys on disk in a badger datastore, encrypting the keys before being stored in the datastore. Each time a key is fetched, it is decrypted first. A single password is used to encrypt all keys.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Lens

    Lens

    Lens is an opt-in search engine and data collection tool

    Lens is an opt-in search engine and data collection tool to aid content discovery of the distributed web. It exposes a simple, minimal API for intelligently indexing and querying content on IPFS. Initially integrated with Temporal, Lens will allow users to optionally have the data they upload be searched and indexed and be awarded with RTC for participating in the data collection process.
    Downloads: 2 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next