Search Results for "large files"
Sort By:
Showing 40 open source projects for "large files"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
1
Git Large File Storage
Git extension for versioning large files
An open source Git extension for versioning large files. Git Large File Storage (LFS) replaces large files such as audio samples, videos, datasets, and graphics with text pointers inside Git, while storing the file contents on a remote server like GitHub.com or GitHub Enterprise. Download and install the Git command line extension. Once downloaded and installed, set up Git LFS for your user account. -
2
Mole
🐹 Deep clean and optimize your Mac.
...It aims to consolidate the functionality of multiple popular Mac utilities—cleaners, uninstallers, disk analyzers, and system tuners—into a single open-source binary. From the command line, you can scan and remove large caches, logs, temporary files, browser remnants, and other junk that quietly accumulates over time. Mole’s smart uninstall mode walks the filesystem to remove not just an application bundle, but also associated caches, preferences, launch agents, logs, and other leftovers in more than twenty locations. It also includes optimization routines that rebuild caches, reset network services, trim swap files, and refresh indexes to keep the system feeling responsive. ... -
3
Cloud Torrent
Cloud Torrent, a self-hosted remote torrent client
Cloud torrent is a a self-hosted remote torrent client, written in Go (golang). You start torrents remotely, which are downloaded as sets of files on the local disk of the server, which are then retrievable or streamable via HTTP. Go is required to install from source. The provided set of core features requires large structural changes and therefore requires a complete rewrite for best results. This rewrite is in progress in the 0.9 branch though it will take quite some time. ... -
4
Stash
An organizer for your videos, written in Go
...Galleries are collections of images. Galleries can be automatically created from zip files and folders containing image files. Preview and view all of your scenes and galleries from your web browser on your PC, tablet or phone. Stash directly streams videos to your web browser. Stash supports streaming of a large variety of formats and codecs to most web browsers. -
5
Navidrome
Your Personal Streaming Service
Navidrome is an open-source, web-based personal music server that lets you stream and manage your entire music collection from any browser or compatible mobile app, effectively turning your own files into a cloud-accessible music service. It supports large libraries and handles a wide variety of audio formats while maintaining very low resource usage, so it runs well even on small servers, Raspberry Pi devices, and other constrained hardware. Users can browse, play, and organize tracks and playlists via a modern web interface, plus they can control access for multiple users with individualized play counts, favorites, and library permissions. ... -
6
Anyquery
Query anything (GitHub, Notion, +40 more) with SQL and let LLMs
Anyquery is an open-source SQL query engine designed to allow users to query data from almost any source using a unified SQL interface. The system enables developers and analysts to run SQL queries on files, APIs, applications, and databases without needing separate connectors or query languages for each platform. Built on top of SQLite, the engine uses a plugin architecture that allows it to extend support to dozens of external services and data sources. Users can query structured files... -
7
tlm
Local CLI Copilot, powered by Ollama
tlm is an open-source command-line AI assistant designed to provide intelligent terminal support using locally running large language models. The project functions as a CLI copilot that helps developers generate commands, explain shell instructions, and answer technical questions directly from the terminal. Instead of relying on cloud APIs or paid AI services, TLM runs entirely on the user’s workstation and integrates with local models managed through the Ollama runtime. -
8
SeaweedFS
Distributed storage system for blobs, objects, files, and data lake
SeaweedFS is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV. SeaweedFS is an independent Apache-licensed open source project with its ongoing development made possible because of the community. SeaweedFS is a... -
9
S5CMD
Parallel S3 and local filesystem execution tool
s5cmd is a very fast S3 and local filesystem execution tool. It comes with support for a multitude of operations including tab completion and wildcard support for files, which can be very handy for your object storage workflow while working with large number of files. There are already other utilities to work with S3 and similar object storage services, thus it is natural to wonder what s5cmd has to offer that others don't. s5cmd supports wide range of object management tasks both for cloud storage services and local filesystems. ... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
plakar
plakar is a backup solution powered by Kloset and ptar
...Plakar is also built for reliability, using immutable storage to reduce the risk of accidental modification or corruption. Its main value is giving users and organizations a practical backup system that combines simple operation, strong protection, and support for large datasets with limited memory usage. -
11
statik
Embed files into a Go executable
...If your static files are not large in size and will be browsed by a few people, statik is the solution you are looking for. statik is a tiny program that reads a directory and generates a source file that contains its contents. The generated source file registers the directory contents to be used by statik file system. In your program, all your need to do is to import the generated package, initialize a new statik file system and serve. -
12
Open Code Review
Open-source & free, battle-tested at Alibaba's scale
...It originated from Alibaba’s internal AI review assistant and was later released as an open-source project for broader developer use. The tool reads Git diffs, analyzes changed files, and generates structured review comments with line-level precision. It is designed to go beyond shallow diff feedback by letting the agent inspect full files, search the codebase, and use surrounding context. Developers can configure model endpoints, making it adaptable to different LLM providers and deployment needs. Its main value is bringing large-scale, agent-assisted review workflows into local and CI-based development environments. -
13
yamlfmt
An extensible command line tool or library to format yaml files
yamlfmt is an extensible formatter that makes YAML files consistent and easy to read across large repositories. It focuses on practical concerns unique to YAML—multi-document streams, anchors and aliases, comments, and block scalars—so a reformat doesn’t destroy semantics or helpful annotations. The tool ships as a single, distributable binary and can also be used as a library, making it simple to drop into CI and editor workflows. -
14
Project X
Originates from XTLS protocol, providing a set of network tools
...The project supports multiple protocols such as VLESS, VMess, Shadowsocks, and Trojan, enabling flexible configuration for different networking scenarios. It is written primarily in Go and is optimized for high performance, making it suitable for both personal and large-scale deployments. Project X also integrates advanced features like REALITY and XTLS, which enhance encryption and disguise traffic to improve privacy and resistance to detection. The platform is highly modular, allowing developers to customize routing rules, transport layers, and proxy behaviors through configuration files or integrations. -
15
PandaWiki
AI-powered open source platform for building intelligent wiki bases
...AI capabilities are integrated to assist with content creation, intelligent question answering, and semantic search, helping users find information more efficiently within stored documentation. PandaWiki also supports importing knowledge from different external sources such as web pages, RSS feeds, sitemaps, and offline files to quickly populate documentation collections. -
16
D2
D2 is a modern diagram scripting language that turns text to diagrams
D2 is a diagram scripting language that turns text to diagrams. It stands for Declarative Diagramming. Declarative, as in, you describe what you want diagrammed, it generates the image. As well, the functioning of the install script is described in detail to alleviate any concern of its use. We recommend using your OS's package manager directly instead for improved security but the install script is by no means insecure. D2 includes a variety of official themes to style your diagrams... -
17
Sloc Cloc and Code (scc)
Sloc, Cloc and Code: scc is a very fast accurate code counter
Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go. The tool is similar to cloc, sloccount and tokei. For counting the lines of code, blank lines, comment lines, and physical lines of source code in many programming languages. The goal is to be the fastest code counter possible, but also perform COCOMO calculations like sloccount, estimate code complexity similar to cyclomatic complexity calculators, and produce... -
18
CubeFS
cloud-native file store
CubeFS is a new generation cloud-native storage that supports access protocols such as S3, HDFS, and POSIX. It is widely applicable in various scenarios such as big data, AI/LLMs, container platforms, separation of storage and computing for databases and middleware, data sharing and protection, etc. Compatible with various access protocols such as S3, POSIX, HDFS, etc., and the access between protocols can be interoperable. Support replicas and erasure coding engines, users can choose... -
19
tsuru
Open source and extensible Platform as a Service (PaaS)
...Grow your application dynamically allocating resources with ease. Let your developers code and understand the business instead of solving infrastructure problems or handling large configuration files. We built the platform as a service atop of battle-tested technologies from Cloud Native Computing Foundation stack. Manage your distributed apps in many kubernetes clusters/regions with a single point of control. Tsuru is an open source project and, as such, we welcome contributions. Feel free to report or fix bugs, contribute to the documentation, or just give your opinion about the software. -
20
WhatsApp MCP Server
WhatsApp MCP server enabling AI access to chats and messaging
whatsapp-mcp is an open source Model Context Protocol (MCP) server that enables AI agents to interact directly with a user’s WhatsApp account through a structured interface. It acts as a bridge between WhatsApp and large language models, allowing controlled access to messages, chats, and contacts. whatsapp-mcp is composed of two main components: a Go-based bridge that connects to the WhatsApp Web API and stores data locally, and a Python-based MCP server that exposes tools for AI... -
21
WeKnora
LLM framework for document understanding and semantic retrieval
WeKnora is an open source framework developed for deep document understanding and semantic information retrieval using large language models. It focuses on analyzing complex and heterogeneous documents by combining multiple processing stages such as multimodal document parsing, vector indexing, and intelligent retrieval. It follows the Retrieval-Augmented Generation (RAG) paradigm, where relevant document segments are retrieved and used by language models to generate accurate, context-aware... -
22
Go Jsonnet
This an implementation of Jsonnet in pure Go
go-jsonnet is a pure Go implementation of the Jsonnet data templating language, which extends JSON with variables, functions, imports, and a standard library so you can generate complex configuration safely. Instead of hand-maintaining massive JSON files, you write concise, reusable templates that evaluate to JSON or YAML, with deterministic semantics and rich error messages. The repository ships both an embeddable VM for Go programs and a command-line interpreter, making it easy to integrate templating into build systems, CLIs, and services. Import paths and custom resolvers let you structure large configuration trees across directories or remote sources, while top-level arguments and external variables parameterize builds per environment. ... -
23
panicparse
Crash your app in style (Golang)
...HTTP web server that serves a very tight and swell snapshot of your goroutines, much more readable than net/http/pprof. >50% more compact output than original stack dump yet more readable. Deduplicates redundant goroutine stacks. Useful for large server crashes. Arguments as pointer IDs instead of raw pointer values. Pushes stdlib-only stacks at the bottom to help focus on important code. Parses the source files if available to augment the output. Works on any platform supported by Go, including Windows, macOS, linux. Full go module support. -
24
The CUE Data Constraint Language
The home of the CUE language. Validate and define text-based config
CUE is an open source data constraint language which aims to simplify tasks involving defining and using data. CUE merges the notion of schema and data. The same CUE definition can simultaneously be used for validating data and act as a template to reduce boilerplate. Schema definition is enriched with fine-grained value definitions and default values. At the same time, data can be simplified by removing values implied by such detailed definitions. The merging of these two concepts enables... -
25
fgprof
fgprof is a sampling Go profiler that allows you to analyze On-CPU
...If this is the first time you hear about fgprof, you should start by reading about The Problem & How it Works. fgprof is compatible with the go tool pprof visualizer. Which tool you prefer is up to you, but one thing I like about Gregg's tool is that you can filter the plaintext files using grep which can be very useful when analyzing large programs.
