Showing 818 open source projects for "large files"

View related business solutions
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Get Started Free
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 1
    RAG Web UI

    RAG Web UI

    RAG Web UI is an intelligent dialogue system based on RAG

    ...The system is designed with a scalable architecture that separates frontend and backend components, enabling distributed deployment and efficient handling of large datasets. It also supports multiple large language model providers.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    SiteDorks

    SiteDorks

    Automate search engine dorking across hundreds of websites

    ...A built-in dataset contains hundreds of websites grouped into categories such as cloud services, developer platforms, documentation sites, social platforms, and communication tools. Users can also supply custom domain lists or CSV files to tailor searches for tasks like penetration testing, bug bounty research, or OSINT investigations.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 3
    omp (Oh My Pi)

    omp (Oh My Pi)

    AI Coding agent for the terminal

    omp (Oh-My-Pi) is an open-source AI agent toolkit focused on creating intelligent coding assistants that operate directly from the terminal environment. The project provides a command-line coding agent capable of analyzing repositories, generating commits, editing code, and interacting with development tools through an integrated tool system. Instead of functioning as a simple prompt-based assistant, the system includes an agent architecture that can inspect Git repositories, analyze...
    Downloads: 34 This Week
    Last Update:
    See Project
  • 4
    Data Version Control

    Data Version Control

    Git-based data version control for machine learning workflows

    ...It enables developers and data scientists to track datasets, machine learning models, and experiment results in a way that integrates with existing Git repositories. Instead of storing large datasets directly in Git, DVC keeps lightweight metadata in the repository while storing the actual data in external storage systems. This approach allows teams to manage large files efficiently while maintaining a clear history of changes to data and models. DVC also provides a pipeline system that defines the stages of machine learning workflows, making experiments reproducible and easier to manage. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • $300 Free Credits for Your Google Cloud Projects Icon
    $300 Free Credits for Your Google Cloud Projects

    Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

    Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
    Start Free Trial
  • 5
    QSV

    QSV

    Blazing-fast Data-Wrangling toolkit

    qsv is a fast, command-line CSV data toolkit written in Rust that extends the capabilities of xsv. It’s designed to make working with CSV files at scale easy and efficient, offering over 40 powerful subcommands for tasks like querying, sampling, splitting, deduplicating, and more. qsv is ideal for data engineers, analysts, and developers who need high-performance CSV manipulation on the command line.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 6
    SeaGOAT

    SeaGOAT

    local-first semantic code search engine

    ...By combining vector search with tools like ripgrep, SeaGOAT provides a hybrid approach that supports both natural language queries and precise keyword matching in source files. It is built primarily in Python and is intended to work on common operating systems such as Linux, macOS, and Windows.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Hackingtool

    Hackingtool

    ALL IN ONE Hacking Tool For Hackers

    HackingTool by Z4nzu is a large collection (“all-in-one”) of tools and scripts for penetration testing / hacking / OSINT etc. It bundles many utilities (port scanners, payload injectors, web attack tools, phishing tools, wireless attack tools, reverse engineering, etc.) into a menu interface. Includes many individual tools, often wrappers or aggregations of existing well-known tools (e.g. port scanners, web attack tools, steganography, hash cracking etc.). A menu interface offering...
    Downloads: 31 This Week
    Last Update:
    See Project
  • 8
    Gaufrette

    Gaufrette

    PHP library that provides a filesystem abstraction layer

    Gaufrette is a PHP library designed to abstract filesystem operations, providing a consistent interface to interact with various storage backends. It allows developers to work with files stored locally, on cloud platforms, or via network protocols, without changing the code. Gaufrette supports plugins for caching, metadata management, and file transformation, making it a flexible choice for file management in web applications.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 9
    dvisvgm

    dvisvgm

    A fast DVI, EPS, and PDF to SVG converter

    The command-line utility dvisvgm is a tool for TEX/LATEX users. It converts DVI, EPS, and PDF files to the XML-based vector graphics format SVG. In contrast to bitmap graphics, vector graphics are arbitrarily scalable without loss of quality. All modern web browsers support a large amount of the current SVG standard 1.1. Furthermore, SVG files can also be displayed with the Java-based Squiggle SVG browser which is part of the Apache Batik project, and the free vector graphics editor Inkscape.
    Downloads: 2 This Week
    Last Update:
    See Project
  • Fully Managed MySQL, PostgreSQL, and SQL Server Icon
    Fully Managed MySQL, PostgreSQL, and SQL Server

    Automatic backups, patching, replication, and failover. Focus on your app, not your database.

    Cloud SQL handles your database ops end to end, so you can focus on your app.
    Try Free
  • 10
    Joplin

    Joplin

    Open source note taking and to-do app with synchronization

    Joplin is a free and open source note-taking and to-do application that can handle a large number of notes in Markdown format, organize them into notebooks and synchronize them with various cloud services. All notes can also be copied, tagged, searched and modified directly from the app or through your own text editor. Notes that are exported from Evernote can be imported into Joplin, be it formatted content, resources, complete metadata or plain Markdown files.
    Downloads: 38 This Week
    Last Update:
    See Project
  • 11
    CompressO

    CompressO

    Convert any video/image into a tiny size. 100% free & open-source

    ...It also offers format conversion features, including transforming videos into GIFs and converting between raster and vector image formats. With a focus on usability, it provides batch processing, metadata viewing, and intuitive workflows, making it suitable for content creators managing large media files.
    Downloads: 20 This Week
    Last Update:
    See Project
  • 12
    Code2Prompt

    Code2Prompt

    Convert codebases into structured prompts optimized for LLM analysis

    code2prompt is an open source command line tool designed to convert an entire codebase into a structured prompt that can be easily used with large language models. It analyzes a project directory, gathers relevant source files, and formats them into a single prompt that includes the source tree and code content. This approach helps developers quickly provide full project context to AI models without manually copying files or assembling prompts. code2prompt is built in Rust and focuses on performance, enabling fast traversal of large repositories while maintaining low resource usage. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    text-extract-api

    text-extract-api

    Document (PDF, Word, PPTX ...) extraction and parse API

    text-extract-api is an open-source service designed to extract readable text from a wide variety of document formats through a simple API interface. The project focuses on converting complex files such as PDFs, images, scanned documents, and office files into structured plain text that can be processed by downstream applications or language models. Instead of requiring developers to integrate multiple document parsing libraries individually, the system centralizes text extraction...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    Uppy

    Uppy

    The next open source file uploader for web browsers

    Uppy fetches files locally and from remote places like Dropbox or Instagram. With its seamless integration, reliability and ease of use, Uppy is truly your best friend in file uploading. Lightweight and modular, plugin-based architecture, easy on dependencies. Large uploads survive network hiccups thanks to resumable file uploads via the open tus standard.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    s3fs

    s3fs

    FUSE-based file system backed by Amazon S3

    s3fs allows Linux, macOS, and FreeBSD to mount an S3 bucket via FUSE. s3fs preserves the native object format for files, allowing use of other tools like AWS CLI. Large subset of POSIX including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes. Compatible with Amazon S3, and other S3-based object stores. Allows random writes and appends, large files via multi-part upload, and renames via server-side copy. User-specified regions, including Amazon GovCloud. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Blade Build System

    Blade Build System

    Blade is a powerful build system from Tencent

    An easy-to-use, fast and modern build system for trunk-based development in large-scale mono repo codebase. The code on the master branch is the development version and should be considered as alpha version. Please prefer using the version on the tags in your formal environment. We will release the verified version on the large-scale internal code base to the tag from time to time.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 17
    llama.vscode

    llama.vscode

    VS Code extension for LLM-assisted code/text completion

    llama.vscode is a Visual Studio Code extension that provides AI-assisted coding features powered primarily by locally running language models. The extension is designed to be lightweight and efficient, enabling developers to use AI tools even on consumer-grade hardware. It integrates with the llama.cpp runtime to run language models locally, eliminating the need to rely entirely on external APIs or cloud providers. The extension supports common AI development features such as code...
    Downloads: 12 This Week
    Last Update:
    See Project
  • 18
    Tongyi DeepResearch

    Tongyi DeepResearch

    Tongyi Deep Research, the Leading Open-source Deep Research Agent

    DeepResearch (Tongyi DeepResearch) is an open-source “deep research agent” developed by Alibaba’s Tongyi Lab designed for long-horizon, information-seeking tasks. It’s built to act like a research agent: synthesizing, reasoning, retrieving information via the web and documents, and backing its outputs with evidence. The model is about 30.5 billion parameters in size, though at any given token only ~3.3B parameters are active. It uses a mix of synthetic data generation, fine-tuning and...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 19
    Google Workspace MCP Server

    Google Workspace MCP Server

    Control Gmail, Google Calendar, Docs, Sheets, Slides, Chat, Forms

    Google Workspace MCP is an open-source server that connects AI assistants to Google Workspace services through the Model Context Protocol (MCP), allowing large language models to interact directly with productivity tools. The project exposes a wide set of Google services including Gmail, Google Drive, Docs, Sheets, Slides, Calendar, Chat, and other Workspace components as structured tools that an AI system can call programmatically. By acting as a bridge between AI clients and the Google ecosystem, the server enables automated workflows such as searching emails, creating calendar events, retrieving documents, or editing files without leaving the AI environment. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 20
    Dufs

    Dufs

    A file server that supports static serving, uploading, searching

    Dufs is a compact Rust-based file server for sharing and managing files through a browser, command line, or WebDAV client. It can serve static content, upload files and folders, search directories, create or edit files, and package folders as downloadable archives. Transfers support resumable and partial uploads or downloads, which is useful for large files and unstable connections. Account-based rules provide read-only or read-write permissions for specific paths, including anonymous access when desired. ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 21
    S5CMD

    S5CMD

    Parallel S3 and local filesystem execution tool

    s5cmd is a very fast S3 and local filesystem execution tool. It comes with support for a multitude of operations including tab completion and wildcard support for files, which can be very handy for your object storage workflow while working with large number of files. There are already other utilities to work with S3 and similar object storage services, thus it is natural to wonder what s5cmd has to offer that others don't. s5cmd supports wide range of object management tasks both for cloud storage services and local filesystems. ...
    Downloads: 9 This Week
    Last Update:
    See Project
  • 22
    claude-obsidian

    claude-obsidian

    Claude + Obsidian knowledge companion

    claude-obsidian is an AI-powered knowledge engine that transforms an Obsidian vault into a self-organizing, continuously evolving wiki. Instead of acting as a simple chat assistant, it autonomously creates, links, and maintains structured knowledge based on user inputs and external sources. The system follows the LLM Wiki pattern, where information is stored as persistent markdown files that grow richer over time through cross-referencing and synthesis. It includes features such as...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 23
    LeoCAD

    LeoCAD

    A CAD application for creating virtual LEGO models

    Design virtual models you can build with LEGO® bricks. LeoCAD has an intuitive interface that is designed to allow new users to start creating new models without having to spend too much time learning the application. At the same time, it has a rich feature set that enables experienced users to build models by using techniques that are more advanced. LeoCAD is fully compatible with the LDraw Standard and related tools, and it reads and writes LDR and MPD files so that you can share and...
    Downloads: 50 This Week
    Last Update:
    See Project
  • 24
    Expat

    Expat

    Fast streaming XML parser written in C99 with >90% test coverage

    Welcome to Expat, a stream-oriented XML parser library written in C. Expat excels with files too large to fit RAM, and where performance and flexibility are crucial. There are a number of applications, libraries, and hardware using Expat, as well as bindings and 3rd-party wrappers. Expat is packaged everywhere. This is Expat, a C99 library for parsing XML 1.0 Fourth Edition, started by James Clark in 1997. Expat is a stream-oriented XML parser.
    Downloads: 37 This Week
    Last Update:
    See Project
  • 25
    File Nesting Config for VS Code

    File Nesting Config for VS Code

    Config of File Nesting for VS Code

    This project provides a curated configuration snippet for the file-nesting feature of Visual Studio Code, authored by Anthony Fu (antfu). The goal is to help developers organize large code-bases by collapsing “secondary” or generated files (for example build artifacts, tests, config variants) under their primary files in the Explorer tree. It supports VS Code version 1.67 and above by enabling the built-in "explorer.fileNesting" setting. It is somewhat opinionated, offering a broad list of patterns (for example hiding .env.*, *.freezed.dart, etc) and it also includes an optional VS Code extension to automatically update the nesting config from the repo. ...
    Downloads: 3 This Week
    Last Update:
    See Project
Auth0 Logo