Search Results for "large files"
Sort By:
Showing 31 open source projects for "large files"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
1
plakar
plakar is a backup solution powered by Kloset and ptar
...Plakar is also built for reliability, using immutable storage to reduce the risk of accidental modification or corruption. Its main value is giving users and organizations a practical backup system that combines simple operation, strong protection, and support for large datasets with limited memory usage. -
2
Dinky
Dinky makes files smaller
Dinky is a lightweight developer tool designed to simplify interactions with large language models by providing a streamlined interface for prompt execution and experimentation. It focuses on usability, offering a minimal environment where developers can quickly test prompts, iterate on outputs, and refine workflows without complex setup. The project is built with simplicity in mind, making it easy to integrate into existing development processes or use as a standalone experimentation tool.... -
3
ByteSync
All-in-One Sync, Backup & Deduplication Tool
ByteSync is a powerful open-source tool for remote file comparison and synchronization, designed to transfer only what truly matters: the differences. Whether you're syncing large files, backing up remote folders, or handling extensive sets of small files, ByteSync delivers speed, security, and efficiency—without unnecessary data transfers. Compatible with Windows, macOS, and Linux, ByteSync leverages cloud-based orchestration with end-to-end encryption, eliminating the need for VPNs or firewall configurations. ... -
4
DAR - Disk ARchive
For full, incremental, compressed and encrypted backups or archives
DAR is a command-line backup and archiving tool that uses selective compression (not compressing already compressed files), strong encryption, may split an archive in different files of given size and provides on-fly hashing, supports differential backup with or without binary delta, ftp and sftp protocols to remote cloud storage Archive internal's catalog, allows very quick restoration even a single file from a huge, eventually sliced, compressed, encrypted archive eventually located on... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
fpart
Sort files and pack them into partitions
...It is developped in C and available under the BSD license. It splits a list of directories and file trees into a certain number of partitions, trying to produce partitions with the same size and number of files. It can also produce partitions with a given number of files or a limited size. Once generated, partitions are either printed as file lists to stdout (default) or to files. Those lists can then be used by third party programs. Fpart also includes a live mode, which allows it to crawl very large filesystems and produce partitions in live. ... -
6
Underscore Backup
Private, secure backups in the cloud.
Private, secure backups in the cloud of any size with minimal resource usage exactly the way you want them. Your data is encrypted by default using encryption keys only available to you and before leaving your network. Backed up data is signed to ensure protection from tampering. Data can be stored with any amount of redundancy and even multiple backup locations simultaneously. No information about the contents of your data is saved in any backup location. Only you can download and... -
7
pibackup
Raspberry Pi backup & restore tool – create, shrink and compress
...It supports live backups of running systems as well as offline image creation from inactive drives, providing safe and flexible restore options. Unlike typical SD card tools, pibackup is optimized for large storage devices like SSDs and HDDs, while still working seamlessly with smaller devices. It backs up the first two partitions of any storage device and enables selective restoration. After backup, pibackup can automatically remove specified files and folders, shrink the image, and compress it efficiently using Zstandard (.zst) to save space. ... -
8
Unix GNU Windows
Packages to create a Unix like environment under MS-Windows
At this point this project is mainly wpkg which is a replica of dpkg and apt-get that works under Microsoft Windows and Unices. Since version 0.7.0 it works very nicely as it includes most of the important functionality of dpkg (i.e. most everything except dselect functions.) Otherwise, the Unix GNU Windows is expected to be a large set of packages that wpkg can handle. Packages of all the software available under MinGW and GnuWin32 so you can painlessly build a complete Unix like... -
9
mp3 library, advanced ID3V1 and ID3V2 tagger, player. Organize a large mp3 library, over 40,000 songs. Speech synthesis and tag backup utilities. Scripts to maintain and organize song files.
-
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
10
DIASER
Cloud storage class, open source software.
DIASER, Geo-data duplication long-term archive system & WAN vault. Manage mixed data archives generated by existing backup software. Ensure availability using commodity hardware. Retain administrative and financial control. -
11
Restriping Tools for Lustre (Retools)
{bzip2,gzip,rsync,tar} with automatic striping according to file size
Retools is a set of modifications to the commonly used open source utilities bzip2, gzip, rsync, and tar that automatically selects the Lustre stripe count for created and/or extracted files according to the sizes of the files involved. By striping large files over a higher number of physical disks and small files over a lower number, aggregate I/O bandwidth for large files is maximized and the impact to the file system due to small files is minimized. -
12
DataFinder is a data management client developed in Python that primarily targets the management of scientific technical data. The system is able to handle large amounts of data and can be easily integrated in existing working environments.
-
13
BigSync is a simple utility that allows to incremetally backup huge files, particularly disk images for virtual machines and database files. BigSync stores these files efficiently in a compressed directory hash and is able to handle files of 4 TB
-
14
Backup and restore of files to web mail systems, ftp, sftp. Uses free storage of gmail/hotmail etc. Archives files, splits large files, encrypts and uploads. Requires python (tested with python 2.5)
-
15
This app intents to be an easy way to make backups of large amount of files into medias such as CDs or DVDs. Also it compress groups of files to fit in the size of dest. media. To avoid integrity problems during decompression, no files are divided.
-
16
Split a large filesystem into groups of files of less than 4.5 gig so they can be burned to a DVD. No archiving, no compression, it makes hard links to the original files so you can easily delete the tree structure after you've burned them to DVD.
-
17
DiscSpan is a tool that will take that a large directory full of files and automatically burn a series of DVDs to near capacity, without the need or hassle of creating individual ISOs while keeping the files individually accessible.
-
18
A free file splitting tool that cuts large files into smaller parts and a merge-script which you can copy to otherwise-too-small memory sticks etc and then put them together on the target computer.
-
19
This is a backup program with a simple user interface; can copy large files (>700MBs) and can do automatic backups to a specific folder (could be any mounted HD partition, USB HardDrive or memory stick)
-
20
Finddupe is a VERY FAST command line C program to catalog very large archives, identifying duplicate files even when offline. It has many features. You can easily grep a catalog to find what you have, and locate where it is.
-
21
Storesim simulates creation of large amount of random files. Directory structure created is similar to what is done in very large file repositories: based on hashdirs (found in mailservers, NFS servers, files servers, image databases...)
-
22
Destral is an open source, multiplatform implementation of the Hacha 3.0, Hacha 3.5 and HJSplit split and join algorithms. These utilities are widely used in forums and news to distribute one large file as many smaller files. A Qt GUI is also planned
-
23
Browseable Online Backup System (BOBS) is a complete online backup system. It uses large disks for storing backups and lets users browse and restore the files using a webbrowser.
-
24
Lossless compression program with various algorithms included. Intended for large XML files, but can compress any files. Best results with block compression (BWT+MTF+RLE) on large block over alphabet of words.
-
25
Alexandria is an archive system for large data amounts. Suitable for inhomogenous collections of books, media files, art items and other artifacts. Main focus is on easy usage, small executable file and portability.
