Showing 18 open source projects for "large files"

View related business solutions
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 1
    Swiss File Knife

    Swiss File Knife

    One hundred command line tools in a small and portable binary.

    Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ...
    Leader badge
    Downloads: 525 This Week
    Last Update:
    See Project
  • 2
    DAR - Disk ARchive

    DAR - Disk ARchive

    For full, incremental, compressed and encrypted backups or archives

    DAR is a command-line backup and archiving tool that uses selective compression (not compressing already compressed files), strong encryption, may split an archive in different files of given size and provides on-fly hashing, supports differential backup with or without binary delta, ftp and sftp protocols to remote cloud storage Archive internal's catalog, allows very quick restoration even a single file from a huge, eventually sliced, compressed, encrypted archive eventually located on...
    Leader badge
    Downloads: 113 This Week
    Last Update:
    See Project
  • 3
    sfxPackager

    sfxPackager

    Setup / install creation system for Windows.

    (NOW PRIMARILY HOSTED ON GITHUB @ https://www.github.com/keelanstuart/sfxPackager) Youtube video tutorials for sfxPackager: https://youtube.com/playlist?list=PLaed72lE3UjgzdL1qOys-vxemSUOeGJWf sfxPackager allows you to create setup / install packages for Windows, with a user-friendly, project-based GUI and integrated Javascript interpreter featuring an extensive API for handling more complex install tasks. User's Guide:...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    Annoy

    Annoy

    Approximate Nearest Neighbors in C++/Python optimized for memory usage

    Annoy (Approximate Nearest Neighbors Oh Yeah) is a C++ library with Python bindings to search for points in space that are close to a given query point. It also creates large read-only file-based data structures that are mmapped into memory so that many processes may share the same data. There are some other libraries to do nearest neighbor search. Annoy is almost as fast as the fastest libraries, (see below), but there is actually another feature that really sets Annoy apart: it has the ability to use static files as indexes. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 5
    CDC File Transfer

    CDC File Transfer

    Tools for synching and streaming files from Windows to Linux

    cdc-file-transfer is a bandwidth-efficient file transfer and sync tool that uses content-defined chunking to detect and transmit only the parts of files that actually changed. Unlike fixed-size blocks, content-defined chunks are cut at data-dependent boundaries, which means shifts and insertions don’t invalidate the rest of the file’s delta map. The tool maintains chunk fingerprints and a manifest so it can de-duplicate across versions and even across different files that share regions of content. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    bin64ed

    bin64ed

    Base64 encode (or decode) files of any type with this lightweight tool

    bin64ed is a binary base64 encoder/decoder that allows you to encode/decode binary files (such as images, pdfs, etc) to and from base64.
    Downloads: 5 This Week
    Last Update:
    See Project
  • 7

    Unix GNU Windows

    Packages to create a Unix like environment under MS-Windows

    At this point this project is mainly wpkg which is a replica of dpkg and apt-get that works under Microsoft Windows and Unices. Since version 0.7.0 it works very nicely as it includes most of the important functionality of dpkg (i.e. most everything except dselect functions.) Otherwise, the Unix GNU Windows is expected to be a large set of packages that wpkg can handle. Packages of all the software available under MinGW and GnuWin32 so you can painlessly build a complete Unix like...
    Downloads: 6 This Week
    Last Update:
    See Project
  • 8
    Dropbox Lepton

    Dropbox Lepton

    Lepton is a tool and file format for losslessly compressing JPEGs

    Lepton image compression, saving 22% losslessly from images at 15MB/s. Lepton achieves a 22% savings reduction for existing JPEG images, by predicting coefficients in JPEG blocks and feeding those predictions as context into an arithmetic coder. Lepton preserves the original file bit-for-bit perfectly. It compresses JPEG files at a rate of 5 megabytes per second and decodes them back to the original bits at 15 megabytes per second, securely, deterministically, and in under 24 megabytes of...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    mp3 library, advanced ID3V1 and ID3V2 tagger, player. Organize a large mp3 library, over 40,000 songs. Speech synthesis and tag backup utilities. Scripts to maintain and organize song files.
    Downloads: 0 This Week
    Last Update:
    See Project
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 10
    DupLichaSe

    DupLichaSe

    A Fast Duplicate File Detector with graph based semi-automatic cleaner

    ...YES!! There is!! ...This Software will ALSO help you and delete duplicate files, after you must have taken action on a a FEW important files(i.e large files that are duplicates). ++Thanks to its trivial Graph based suggestion System
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11

    qlsdup

    GUI based lightweight duplicate file finder / remover.

    ...This is basically a reimplementation of dupfinder as: it doesn't compile on my computer, the executable won't work either, the projects seems dead and I didn't wanna work through the original code. So Look'n'Feel should be somewhat the same, though some changes have been made. Algorithm is simple and suitable for large file sets with few differences: basic set of duplicate candidates is determined by file size, then candidates are compared byte-wise. So for files which don't start to differ by growing at the tail it reduces read operations greatly compared to hash-based comparision (i.e. test case: 40GB of files, 16GB RAM, many differences: initial compare (uncached by OS) around 300sec, subsequent compare (relevant file parts cached by OS) ca. 2sec) Note: this program is not related to lsdup
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    Split a large filesystem into groups of files of less than 4.5 gig so they can be burned to a DVD. No archiving, no compression, it makes hard links to the original files so you can easily delete the tree structure after you've burned them to DVD.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    FastDup is a tool to find identical files within directory trees, with a focus on speed, many files, and large files. Extremely fast even on large sets of data.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    Alexandria is an archive system for large data amounts. Suitable for inhomogenous collections of books, media files, art items and other artifacts. Main focus is on easy usage, small executable file and portability.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Flexible, secure file-transfer utility similar to rsync achieving high transfer rates for both large and small files on networks with both LANs and WANs (networks with low or high latencies). Supports interactive batch as well as scripting operation.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Command-line hash file checker/creator. Supports .sfv, .md5, .sha1 and .sha2, and is easily extendable. Includes animated progress bars and recursive directory handling. Supports large numbers of files. Includes AppleScript droplets for use on Mac OS X.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    wxSpilt is a graphic interface based tool that allows to split large files in smaller parts and to join back them. It has been wholy developed using wxWidgets classes
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    parchive2 provides PAR 2.0 libraries and tools for creating parity files and recovering data using them. The key advance of PAR 2.0 is that you do not need to break a large file into smaller files before making parity files. See the parchive project for
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next
Auth0 Logo