Search Results for "data"
Sort By:
Showing 174 open source projects for "data"
View related business solutions-
Build on Google Cloud with $300 in Free CreditStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query exabytes in BigQuery, or build AI apps with Vertex AI and Gemini. Once your credits are used, keep building with 20+ products with free monthly usage, including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. Sign up to start building right away.
-
Go From Idea to Deployed AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
1
restic
Fast, secure and efficient backup program
...It supports backends for storing backups natively, including on the local directory, sftp server (via SSH), HTTP REST server (protocol rest server), OpenStack Swift, among many others. It also uses cryptography to ensure the confidentiality and integrity of your data. Restic supports Windows, macOS and Linux operating systems, as well as FreeBSD and OpenBSD. -
2
Velero
Backup and migrate Kubernetes applications and their persistent volume
...Velero is an open source tool to safely backup and restore, perform disaster recovery, and migrate Kubernetes cluster resources and persistent volumes. Reduces time to recovery in case of infrastructure loss, data corruption, and/or service outages. Enables cluster portability by easily migrating Kubernetes resources from one cluster to another. Offers key data protection features such as scheduled backups, retention schedules, and pre or post-backup hooks for custom actions. Backup your Kubernetes resources and volumes for an entire cluster, or part of a cluster by using namespaces or label selectors. ... -
3
Brotli
Brotli compression format
...After the overflow happens, memcpy is invoked with a gigantic num value, that will likely cause the crash. Brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm, Huffman coding and 2nd order context modeling, with a compression ratio comparable to the best currently available general-purpose compression methods. It is similar in speed with deflate but offers more dense compression. The specification of the Brotli Compressed Data Format is defined in RFC 7932. ... -
4
ArchiveBox
Open source self-hosted web archiving
...Archive.org does a great job as a centralized service, but saved URLs have to be public, and they can't save every type of content. ArchiveBox is an open source tool that lets organizations & individuals archive both public & private web content while retaining control over their data. It can be used to save copies of bookmarks, preserve evidence for legal cases, backup photos from FB/Insta/Flickr or media from YT/Soundcloud/etc., save research papers, and more. ArchiveBox is an open-source, self-hosted web archiving tool for saving websites offline. It helps organizations and individuals preserve bookmarks, research papers, and social media content, among others. -
Deploy Apps in Seconds with Cloud RunCloud Run is the fastest way to deploy containerized apps. Push your code in Go, Python, Node.js, Java, or any language and Cloud Run builds and deploys it automatically. Get fast autoscaling, pay only when your code runs, and skip the infrastructure headaches. Two million requests free per month. And new customers get $300 in free credit.
-
5
Kopia
Cross-platform backup tool for Windows, macOS and Linux
...Its architecture supports end-to-end encryption, optional compression, and deduplication, so multiple backups can share data efficiently, and repositories can be stored securely even in untrusted locations. -
6
Zippy
Pure Nim implementation of deflate, zlib, gzip and zip
Zippy is a pure Nim implementation of DEFLATE, ZLIB, GZIP, and ZIP data compression formats, aiming to be small, performant, and dependency-free. -
7
OpenArchiver
An open-source platform for legally compliant email archiving
OpenArchiver is a comprehensive, self-hosted email archiving and compliance platform built to help organizations ingest, index, store, and search email communication data across diverse sources like Gmail, Microsoft 365, IMAP, PST, and more. It’s designed for scenarios where reliable, tamper-proof archiving and full-text search across both emails and attachments are essential for legal discovery, compliance, or long-term records retention. The platform combines a modern web UI with powerful backend services, including fast indexing, deduplication, encryption at rest, and asynchronous ingestion workflows, making it suitable for both small teams and enterprise deployments. ... -
8
Stash Kubernetes
Backup your Kubernetes Stateful Applications
A complete Kubernetes native disaster recovery solution for backup and restore your volumes and databases in Kubernetes on any public and private clouds. Backup your data in Kubernetes native way. Stash uses Custom Resource Definition (CRD) to specify targets and behaviors of the backup and restore process. Schedule a backup for your workloads in the same way you deployed them into Kubernetes. Back up your Kubernetes volumes mounted in a workload. Stash supports Deployment, DaemonSet, StatefulSet, ReplicaSet, ReplicationController, OpenShift DeploymentConfig etc. ... -
9
Snappy
A fast compressor/decompressor
Snappy is a compression/decompression library. It does not aim for maximum compression, or compatibility with any other compression library; instead, it aims for very high speeds and reasonable compression. For instance, compared to the fastest mode of zlib, Snappy is an order of magnitude faster for most inputs, but the resulting compressed files are anywhere from 20% to 100% bigger. Snappy is intended to be fast. On a single core of a Core i7 processor in 64-bit mode, it compresses at... -
Catch Bugs Before Your Customers DoMove from alert to fix before users notice. AppSignal monitors errors, performance bottlenecks, host health, and uptime—all from one dashboard. Instant notifications on deployments, anomaly triggers for memory spikes or error surges, and seamless log management. Works out of the box with Rails, Django, Express, Phoenix, Next.js, and dozens more. Starts at $23/month with no hidden fees.
-
10
Vorta Backup Client
Desktop Backup Client for Borg Backup
Vorta is a backup client for macOS and Linux desktops. It integrates the mighty Borg Backup with your favorite desktop environment to protect your data from disk failure, ransomware and theft. -
11
RSNAPSHOT
A tool for backing up your data using rsync
rsnapshot is a filesystem snapshot utility for making backups of local and remote systems. It leverages rsync and hard links to create efficient incremental backups, allowing users to maintain multiple backups without consuming excessive disk space. -
12
Game Extractor
Open and edit the archive files used in over 5200 games.
Reads and writes archives used in many popular games. Great for mod development and game translations. Supports over 5200 games, with more games added through small plugins. Also shows file previews and converts them to different formats. -
13
Underscore Backup
Private, secure backups in the cloud.
Private, secure backups in the cloud of any size with minimal resource usage exactly the way you want them. Your data is encrypted by default using encryption keys only available to you and before leaving your network. Backed up data is signed to ensure protection from tampering. Data can be stored with any amount of redundancy and even multiple backup locations simultaneously. No information about the contents of your data is saved in any backup location. ... -
14
A web based Metadata Catalog Server for data description and discovery. Supports both generic and geospatial data discovery. It implements international standards (e.g. ISO19115/19139/19119, ISO19115-3, DCAT-AP, CSW 2.0, OGC API Records). It originates from the United Nations and is used by many governments as geoportal software. Active development and discussion takes place on GitHub and OSGeo Discourse.
-
15
g3fc
A modern, fast, and secure file archiver with built-in data resilience
...G3FC excels with its technical features: blazing-fast Zstandard compression, strong AES-256-GCM authenticated encryption, and optional Forward Error Correction (FEC) to prevent data corruption. Its unique footer design allows for instant file indexing and searching, even in massive archives, eliminating the slow scans required by formats like TAR. G3FC is built for developers and power users, with native, open-source implementations available in Rust, Go, C#, and Python for true cross-platform performance. -
16
Zip-Ada
A standalone, portable Ada library for .zip archives
Zip-Ada is a library for .zip archives. Full sources are in Ada and are unconditionally portable. Input and output can be any stream (file, buffer,...) for archive creation as well as data extraction. Task safe and endian-neutral. More information on: http://unzip-ada.sf.net Alire crate: https://alire.ada.dev/crates/zipada Mirror: https://github.com/zertovitch/zip-ada/ -
17
DAR - Disk ARchive
For full, incremental, compressed and encrypted backups or archives
DAR is a command-line backup and archiving tool that uses selective compression (not compressing already compressed files), strong encryption, may split an archive in different files of given size and provides on-fly hashing, supports differential backup with or without binary delta, ftp and sftp protocols to remote cloud storage Archive internal's catalog, allows very quick restoration even a single file from a huge, eventually sliced, compressed, encrypted archive eventually located on a remote cloud storage, by only reading/fetching the necessary data to perform the operation. Dar saves *all* UNIX inode types, takes care of hard links, sparse files as well as Extended Attributes (MacOS X file forks, Linux ACL, SELinux tags, user attributes) and some Filesystem Specific Attributes (Linux ext2/3/4, Mac OS X HFS+) more details at: http://dar.linux.free.fr/doc/Features.html -
18
zpaqfranz
Zpaq compatible archiver for Win, Linux, Free/OpenBSD, Solaris & MacOS
...Optimized for cloud/NAS/USB with ultra-low bandwidth, military-grade encryption, and 1GB/s+ speeds on modern hardware. Why Choose zpaqfranz? ✓ Complete: Single/multi-file storage architecture ✓ Modern: SHA-2, SHA-3, BLAKE3, XXH3 and more ✓Paranoid: Antiransomware data verification with integrity checks ✓ Runs everywhere: TrueNAS, ARM-powered, even ESXi ✓ Lightning-fast: Multi-core processing + hardware acceleration ✓ Battle-tested: 15+ years of active development since 2009 Perfect for system administrators managing critical backups and anyone needing bulletproof archival solutions with enterprise-grade reliability. ... -
19
BWTC32Key
A file compressor with AES256CTR and Base32768 binary-to-text encoding
BWTC32Key is a program I wrote that compresses data, then optionally encrypts it, and then outputs a Base32768 representation as the final output -
20
Rockstor
BTRFS based NAS and private cloud storage solution
...These Rock-ons, combined with advanced NAS features, turn Rockstor into a private cloud storage solution accessible from anywhere, giving users complete control of cost, ownership, privacy and data security. Rockstor UI is written in Javascript, making it simple to manage everything from your Web browser. The backend is written in Python and exposes RESTful APIs to easily extend functionality! -
21
ccccd
Channel Code Copy of Compact Discs
Channel Code Copy of Compact Discs: This project has the goal to archive the complete content of CDs on the channel code layer. Here, the NRZI signal which stems from the laser-pickup of a CD player is recorded directly, providing sort of a pit-land photo of the CD. The resulting image file, in turn, is demodulated and decoded in software, i.e. within a virtual CD player. The digital audio channel code on LaserDiscs and CD Video discs can be handled as well. Note: The image extraction... -
22
JDiskCat
Multi-platform disk cataloguing utility written in java.
Easy-to-use multi-platform disk cataloguing program supporting local or removable media - drives and folders. Uses XML files as a data storage. It was originally created in 2010 to catalogue software compilations (also called freeware compilations) and CDs distributed with computer magazines. It was later improved to support any kind of disk and folder. It can be used to catalogue fragile disks like CDs, floppies, external hard drives, usb sticks, memory cards which are easy to damage. ... -
23
ByteSync
All-in-One Sync, Backup & Deduplication Tool
...Whether you're syncing large files, backing up remote folders, or handling extensive sets of small files, ByteSync delivers speed, security, and efficiency—without unnecessary data transfers. Compatible with Windows, macOS, and Linux, ByteSync leverages cloud-based orchestration with end-to-end encryption, eliminating the need for VPNs or firewall configurations. No continuous background syncing, no bloat—just fast, on-demand file synchronization between remote devices. -
24
PCA
binary encryption archiver
Petoron Crypto Archiver (PCA) Key features: AES-256-CFB encryption with unique IV per archive Argon2id key derivation (256MB RAM / time_cost=3 / parallelism=4) HMAC-SHA512 integrity and anti-tampering check No compression, no fingerprinting, no trace of original data Works with both single files and entire directories Fully CLI-based, portable, and open format (.pca) https://github.com/01alekseev/PCA -
25
fpart
Sort files and pack them into partitions
...Hooks are available to act on those partitions (e.g. immediatly start a transfer using rsync(1)) without having to wait for the filesystem traversal job to be finished. Used this way, fpart can be seen as a powerful data migration tool.
