Showing 132 open source projects for "data"

View related business solutions
  • Ship AI Apps Faster with Vertex AI Icon
    Ship AI Apps Faster with Vertex AI

    Go from idea to deployed AI app without managing infrastructure. Vertex AI offers one platform for the entire AI development lifecycle.

    Ship AI apps and features faster with Vertex AI—your end-to-end AI platform. Access Gemini 3 and 200+ foundation models, fine-tune for your needs, and deploy with enterprise-grade MLOps. Build chatbots, agents, or custom models. New customers get $300 in free credit.
    Try Vertex AI Free
  • 99.99% Uptime for MySQL and PostgreSQL on Google Cloud Icon
    99.99% Uptime for MySQL and PostgreSQL on Google Cloud

    Enterprise Plus edition delivers sub-second maintenance downtime and 2x read/write performance. Built for critical apps.

    Cloud SQL Enterprise Plus gives you a 99.99% availability SLA with near-zero downtime maintenance—typically under 10 seconds. Get 2x better read/write performance, intelligent data caching, and 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server with built-in vector search for gen AI apps. New customers get $300 in free credit.
    Try Cloud SQL Free
  • 1
    DwarFS

    DwarFS

    A fast high compression read-only file system for Linux, Windows

    ...A fast high compression read-only file system for Linux and Windows. DwarFS is a read-only file system with a focus on achieving very high compression ratios in particular for very redundant data. This probably doesn't sound very exciting, because if it's redundant, it should compress well. However, I found that other read-only, compressed file systems don't do a very good job at making use of this redundancy. See here for a comparison with other compressed file systems. DwarFS also doesn't compromise on speed and for my use cases, I've found it to be on par with or perform better than SquashFS. ...
    Downloads: 28 This Week
    Last Update:
    See Project
  • 2
    CssSelector Component

    CssSelector Component

    Converts CSS selectors to XPath expressions

    XPath expressions are incredibly flexible, so there is almost always an XPath expression that will find the element you need. Unfortunately, they can also become very complicated, and the learning curve is steep. Even common operations (such as finding an element with a particular class) can require long and unwieldy expressions. CSS selectors are less powerful than XPath, but far easier to write, read and understand. Since they are less powerful, almost all CSS selectors can be converted to...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    s3fs

    s3fs

    FUSE-based file system backed by Amazon S3

    s3fs allows Linux, macOS, and FreeBSD to mount an S3 bucket via FUSE. s3fs preserves the native object format for files, allowing use of other tools like AWS CLI. Large subset of POSIX including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes. Compatible with Amazon S3, and other S3-based object stores. Allows random writes and appends, large files via multi-part upload, and renames via server-side copy. User-specified regions, including Amazon GovCloud....
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    IPFS

    IPFS

    IPFS implementation in Go

    ...HTTP downloads files from one computer at a time instead of getting pieces from multiple computers simultaneously. Peer-to-peer IPFS saves big on bandwidth, up to 60% for video, making it possible to efficiently distribute high volumes of data without duplication. The average lifespan of a web page is 100 days before it's gone forever. It's not good enough for the primary medium of our era to be this fragile. IPFS keeps every version of your files and makes it simple to set up resilient networks for mirroring data. The Internet has turbocharged innovation by being one of the great equalizers in human history, but increasing consolidation of control threatens that progress. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Build on Google Cloud with $300 in Free Credit Icon
    Build on Google Cloud with $300 in Free Credit

    New to Google Cloud? Get $300 in free credit to explore Compute Engine, BigQuery, Cloud Run, Vertex AI, and 150+ other products.

    Start your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query exabytes in BigQuery, or build AI apps with Vertex AI and Gemini. Once your credits are used, keep building with 20+ products with free monthly usage, including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. Sign up to start building right away.
    Start Free Trial
  • 5
    Claude Code Safety Net

    Claude Code Safety Net

    A Claude Code plugin that acts as a safety net

    ...The repository defines patterns and reusable components for validating agent decisions, sanitizing user inputs, and enforcing operational boundaries, making it easier to design fail-safe integrations with both internal toolchains and external APIs. It includes example safety checks that cover common categories like infinite loops, unsafe system commands, data leakage risks, and visibility constraints, which help engineering teams anticipate and defend against unpredictable agent behavior.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    VeraCrypt

    VeraCrypt

    Open source disk encryption with strong security for the Paranoid

    ...This enhanced security adds some delay ONLY to the opening of encrypted partitions without any performance impact to the application use phase. This is acceptable to the legitimate owner but it makes it much harder for an attacker to gain access to the encrypted data. All released files are PGP signed with key ID=0x680D16DE, available on key servers and downloadable at https://www.idrix.fr/VeraCrypt/VeraCrypt_PGP_public_key.asc VeraCrypt can mount TrueCrypt volumes. It also can convert them to VeraCrypt format. Documentation: https://www.veracrypt.fr/en/Documentation.html FAQ : https://www.veracrypt.fr/en/FAQ.html
    Leader badge
    Downloads: 1,978 This Week
    Last Update:
    See Project
  • 7
    WipeFreeSpace

    WipeFreeSpace

    Secure wiping/shredding of free disk space with many methods

    ...Additionally, WipeFreeSpace can finalize wiping the filesystem by writing blocks of zeros, which is friendly for sparse files, virtual systems and other places where zeroed-out space is not physically allocated. See the project homepage https://wipefreespace.sourceforge.io and the project Wiki in the menu above. To prevent clear-text data from being left on the drive in the first place, you can use LibSecRm (https://libsecrm.sourceforge.io), which wipes the data on-the-fly.
    Leader badge
    Downloads: 85 This Week
    Last Update:
    See Project
  • 8
    Partclone
    Partclone is a project like the well-known backup utility "Partition Image" a.k.a partimage. Partclone provide utilities to back up used blocks and design for higher compatibility of the file system using supported library like e2fslibs.
    Leader badge
    Downloads: 63 This Week
    Last Update:
    See Project
  • 9

    NBT File System Utilities

    Inspecting and manipulating NBT as a file system

    Named Binary Tag (NBT) is a binary format designed for and used by the game Minecraft to store various data including worlds, player data and many other things. This project provides a way to access those data by simply mounting the corresponding data file as a file system, then reading and writing any value as usual file system nodes. By combining with standard Unix file operation tools, batch editing or copying massive amount of data is very easy, comparing to other generic NBT editing tools. ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • AI-generated apps that pass security review Icon
    AI-generated apps that pass security review

    Stop waiting on engineering. Build production-ready internal tools with AI—on your company data, in your cloud.

    Retool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
    Try Retool free
  • 10
    MooseFS

    MooseFS

    Fault tolerant, POSIX-compliant, Net Distributed Storage / File System

    MooseFS (MFS) is a fault tolerant, highly performing, scaling-out, network distributed file system. It spreads data over several physical servers which are visible to the user as one resource. For standard file operations MooseFS mounted with FUSE acts as other Unix-alike file systems: * A hierarchical structure (directory tree) * Stores POSIX file attributes (permissions, last access and modification times) Supports special files (block and character devices, pipes and sockets) * Symbolic links (file names pointing to target files, not necessarily on MooseFS) and hard links (different names of files which refer to the same data on MooseFS) * Access to the file system can be limited based on IP address and/or password MooseFS on GitHub: https://github.com/moosefs/moosefs Packages repository, download: https://moosefs.com/download Documentation: https://moosefs.com/support Recent changes: https://github.com/moosefs/moosefs/blob/master/NEWS
    Downloads: 1 This Week
    Last Update:
    See Project
  • 11

    fpart

    Sort files and pack them into partitions

    ...Hooks are available to act on those partitions (e.g. immediatly start a transfer using rsync(1)) without having to wait for the filesystem traversal job to be finished. Used this way, fpart can be seen as a powerful data migration tool.
    Downloads: 7 This Week
    Last Update:
    See Project
  • 12
    s3cmd

    s3cmd

    Command line tool for managing Amazon S3 and CloudFront services

    Open-source tool to access Amazon S3 file storage. S3cmd is a free command line tool and client for uploading, retrieving and managing data in Amazon S3 and other cloud storage service providers that use the S3 protocol, such as Google Cloud Storage. Lots of features and options have been added to s3cmd since its very first release in 2008.... we recently counted more than 60 command line options, including multipart uploads, encryption, incremental backup, s3 sync, ACL and Metadata management, S3 bucket size, bucket policies, and more!
    Leader badge
    Downloads: 1,024 This Week
    Last Update:
    See Project
  • 13
    Xorin

    Xorin

    Xorin data erase & clone software

    Xorin is a secure drive erase program that provides the perfect solution to anyone who wants to secure their private data before selling or utilization their PC or drive storage. Xorin is also good in all situations where you want to ensure that deleted data stays deleted and that it can never be recovered. Xorin operates from its own Linux-based bootable environment, Linux or Windows operation system. Xorin supports all popular security methods and standards including DoD 5220.22-M. ...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 14
    fast single-privilege single-address-space preemptive-multithreading persistent data-centric secure multiuser operating system with safe-language and reconfigurable graphical interface
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Synchrorep

    Synchrorep

    Synchronize directories

    Synchrorep is a one click directory synchronization software. All modification will be reported to one to the other and vice versa. Usefull for nomads or speedup differencials backup.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    myrescue is a program to rescue the still-readable data from a damaged harddisk. It is similiar in purpose to dd_rescue, but it tries to quickly get out of damaged areas to first handle the not yet damaged part of the disk and return later.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 17
    recovermypartition
    Recover data from a partition or dd image from a console using python and sleuthkit
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Heliogabalus

    Heliogabalus

    Heliogabalus Rescue Live Linux Distribution

    Forensics, data rescue, data backup, OS and filesystem maintenance and administration. CLI experts only.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    ...A cyclic log has a fixed size upon creation and pointers that refer to the start and end positions within that fixed size.They are useful for recording server output without losing the most recent data.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    diskover

    diskover

    File system crawler and disk space usage software

    diskover is a file system crawler and disk space usage software that uses Elasticsearch to index your file metadata. diskover crawls and indexes your files on a local computer or remote storage server over network mounts. diskover helps manage your storage by identifying old and unused files and give better insights into data change "hotfiles", file duplication "dupes" and wasted space. It is designed to help deal with managing large amounts of data growth and provide detailed storage analytics. See GitHub for requirements and instructions on installing.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    A set of data recovery tools.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 22
    transformenator

    transformenator

    Text and binary file transformation

    Text and binary file transformation. Text-based sed, awk, etc. failed me when I needed a simple way to transform binary files to something else. Transformenator is what resulted.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    ...A shell command generates the contents of the files on request, perhaps from the source files. Configurable caching and monitoring of the source tree to limit CPUand prefetch data.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    DemuxFS is a live filesystem to aid on the analysis of transport streams in digital TV systems such as the SBTVD (ISDB-T), DVB and ATSC.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    ISOLabel

    ISOLabel

    Change volume label on ISO 9660 image and Joliet extension

    isolabel is a program that allows you to change volume label in ISO 9660 image file after it was already created. Moreover, you can specify ISO 9660 and Joliet volume label separately, taking advantage of fancy names in Joliet together with simpler, but longer name in ISO 9660; something that tools like mkisofs/genisoimage does not allow you to do in standard compliant way. This program is written to have minimal software dependency, and work on all platforms.
    Downloads: 0 This Week
    Last Update:
    See Project
MongoDB Logo MongoDB