Search Results for "large files"
Sort By:
Showing 20 open source projects for "large files"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Git Large File Storage
Git extension for versioning large files
An open source Git extension for versioning large files. Git Large File Storage (LFS) replaces large files such as audio samples, videos, datasets, and graphics with text pointers inside Git, while storing the file contents on a remote server like GitHub.com or GitHub Enterprise. Download and install the Git command line extension. Once downloaded and installed, set up Git LFS for your user account. -
2
Stash
An organizer for your videos, written in Go
...Galleries are collections of images. Galleries can be automatically created from zip files and folders containing image files. Preview and view all of your scenes and galleries from your web browser on your PC, tablet or phone. Stash directly streams videos to your web browser. Stash supports streaming of a large variety of formats and codecs to most web browsers. -
3
S5CMD
Parallel S3 and local filesystem execution tool
s5cmd is a very fast S3 and local filesystem execution tool. It comes with support for a multitude of operations including tab completion and wildcard support for files, which can be very handy for your object storage workflow while working with large number of files. There are already other utilities to work with S3 and similar object storage services, thus it is natural to wonder what s5cmd has to offer that others don't. s5cmd supports wide range of object management tasks both for cloud storage services and local filesystems. ... -
4
statik
Embed files into a Go executable
...If your static files are not large in size and will be browsed by a few people, statik is the solution you are looking for. statik is a tiny program that reads a directory and generates a source file that contains its contents. The generated source file registers the directory contents to be used by statik file system. In your program, all your need to do is to import the generated package, initialize a new statik file system and serve. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
5
Open Code Review
Open-source & free, battle-tested at Alibaba's scale
...It originated from Alibaba’s internal AI review assistant and was later released as an open-source project for broader developer use. The tool reads Git diffs, analyzes changed files, and generates structured review comments with line-level precision. It is designed to go beyond shallow diff feedback by letting the agent inspect full files, search the codebase, and use surrounding context. Developers can configure model endpoints, making it adaptable to different LLM providers and deployment needs. Its main value is bringing large-scale, agent-assisted review workflows into local and CI-based development environments. -
6
yamlfmt
An extensible command line tool or library to format yaml files
yamlfmt is an extensible formatter that makes YAML files consistent and easy to read across large repositories. It focuses on practical concerns unique to YAML—multi-document streams, anchors and aliases, comments, and block scalars—so a reformat doesn’t destroy semantics or helpful annotations. The tool ships as a single, distributable binary and can also be used as a library, making it simple to drop into CI and editor workflows. -
7
D2
D2 is a modern diagram scripting language that turns text to diagrams
D2 is a diagram scripting language that turns text to diagrams. It stands for Declarative Diagramming. Declarative, as in, you describe what you want diagrammed, it generates the image. As well, the functioning of the install script is described in detail to alleviate any concern of its use. We recommend using your OS's package manager directly instead for improved security but the install script is by no means insecure. D2 includes a variety of official themes to style your diagrams... -
8
Sloc Cloc and Code (scc)
Sloc, Cloc and Code: scc is a very fast accurate code counter
Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go. The tool is similar to cloc, sloccount and tokei. For counting the lines of code, blank lines, comment lines, and physical lines of source code in many programming languages. The goal is to be the fastest code counter possible, but also perform COCOMO calculations like sloccount, estimate code complexity similar to cyclomatic complexity calculators, and produce... -
9
CubeFS
cloud-native file store
CubeFS is a new generation cloud-native storage that supports access protocols such as S3, HDFS, and POSIX. It is widely applicable in various scenarios such as big data, AI/LLMs, container platforms, separation of storage and computing for databases and middleware, data sharing and protection, etc. Compatible with various access protocols such as S3, POSIX, HDFS, etc., and the access between protocols can be interoperable. Support replicas and erasure coding engines, users can choose... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
tsuru
Open source and extensible Platform as a Service (PaaS)
...Grow your application dynamically allocating resources with ease. Let your developers code and understand the business instead of solving infrastructure problems or handling large configuration files. We built the platform as a service atop of battle-tested technologies from Cloud Native Computing Foundation stack. Manage your distributed apps in many kubernetes clusters/regions with a single point of control. Tsuru is an open source project and, as such, we welcome contributions. Feel free to report or fix bugs, contribute to the documentation, or just give your opinion about the software. -
11
Go Jsonnet
This an implementation of Jsonnet in pure Go
go-jsonnet is a pure Go implementation of the Jsonnet data templating language, which extends JSON with variables, functions, imports, and a standard library so you can generate complex configuration safely. Instead of hand-maintaining massive JSON files, you write concise, reusable templates that evaluate to JSON or YAML, with deterministic semantics and rich error messages. The repository ships both an embeddable VM for Go programs and a command-line interpreter, making it easy to integrate templating into build systems, CLIs, and services. Import paths and custom resolvers let you structure large configuration trees across directories or remote sources, while top-level arguments and external variables parameterize builds per environment. ... -
12
panicparse
Crash your app in style (Golang)
...HTTP web server that serves a very tight and swell snapshot of your goroutines, much more readable than net/http/pprof. >50% more compact output than original stack dump yet more readable. Deduplicates redundant goroutine stacks. Useful for large server crashes. Arguments as pointer IDs instead of raw pointer values. Pushes stdlib-only stacks at the bottom to help focus on important code. Parses the source files if available to augment the output. Works on any platform supported by Go, including Windows, macOS, linux. Full go module support. -
13
The CUE Data Constraint Language
The home of the CUE language. Validate and define text-based config
CUE is an open source data constraint language which aims to simplify tasks involving defining and using data. CUE merges the notion of schema and data. The same CUE definition can simultaneously be used for validating data and act as a template to reduce boilerplate. Schema definition is enriched with fine-grained value definitions and default values. At the same time, data can be simplified by removing values implied by such detailed definitions. The merging of these two concepts enables... -
14
fgprof
fgprof is a sampling Go profiler that allows you to analyze On-CPU
...If this is the first time you hear about fgprof, you should start by reading about The Problem & How it Works. fgprof is compatible with the go tool pprof visualizer. Which tool you prefer is up to you, but one thing I like about Gregg's tool is that you can filter the plaintext files using grep which can be very useful when analyzing large programs. -
15
go-wkhtmltopdf
Golang commandline wrapper for wkhtmltopdf
We needed a way to generate PDF documents from Go. These vary from invoices with highly customizable layouts to reports with tables, graphs and images. In our opinion, the best way to do this was by using HTML/CSS templates as a source for our PDFs. Using CSS print media types and millimeters instead of pixel units we can generate very accurate PDF documents using wkhtmltopdf. It takes care of setting the correct order of options as these can become very long with multiple pages where you... -
16
gopkg
Example for the go pkg's function
gopkg is a large community-driven repository of examples for Go’s standard library packages, created to fill the gap left by the relatively sparse official examples. The project organizes content so that each package has its own directory and each function within that package gets its own Markdown file with code examples. The idea is that developers can quickly look up “how do I actually use this function?” without digging through source code or scattered blog posts. The maintainer provides... -
17
B0Pass
LAN large file transfer tool
Bailing Express: A high-performance "mobile computer super file transfer artifact" and "LAN shared file server" based on Go language. LAN large file transfer tool. Go-based high-performance "mobile phone computer super large file transfer artifact", "LAN shared file server". file sharing server. Simple single executable. Shared file interface (as long as you are in the same LAN or WIFI, you can transfer very large files) Upload file interface (support click and drag) Two-dimensional code scanning interface (supports mobile phone transmission, supports other computers to input URLs). ... -
18
Termshark
A terminal UI for tshark, inspired by Wireshark
A terminal user-interface for tshark, inspired by Wireshark. If you're debugging on a remote machine with a large pcap and no desire to scp it back to your desktop, termshark can help! Read pcap files or sniff live interfaces (where tshark is permitted). Filter pcaps or live captures using Wireshark's display filters. Reassemble and inspect TCP and UDP flows. View network conversations by protocol. Copy ranges of packets to the clipboard from the terminal. -
19
git-sizer
Compute various size metrics for a Git repository
...Ideally, Git repositories should be under 1 GiB, and (without special handling) they start to get unwieldy over 5 GiB. Big repositories take a long time to clone and repack, and take a lot of disk space. Avoid storing generated files (e.g., compiler output, JAR files) in Git. It would be better to regenerate them when necessary, or store them in a package registry or even a fileserver. Avoid storing large media assets in Git. You might want to look into Git-LFS or git-annex, which allow you to version your media assets in Git while actually storing them outside of your repository. ... -
20
CRFS
CRFS: Container Registry Filesystem
...Instead of downloading entire layers upfront, it fetches file ranges on demand and maintains a content-addressed cache, yielding fast startup and lower bandwidth for large images. The system speaks registry protocols and understands layered image formats, resolving whiteouts and overlays so the mounted view matches what a container runtime would see. A FUSE (or platform-equivalent) frontend makes it trivial to integrate with existing tools: compilers, test runners, or debuggers can read files as if they were local. ...
- Previous
- You're on page 1
- Next
