Search Results for "large files"
Sort By:
Showing 34 open source projects for "large files"
View related business solutions-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
BentoPDF
A Privacy First PDF Toolkit
...It offers functionality to merge, split, compress, rotate, and convert PDFs through an easy-to-deploy container or local installation, making it ideal for individuals and teams that handle large volumes of PDF files regularly. Because it runs entirely on your own system or server, BentoPDF helps ensure that sensitive documents never leave your environment — a critical consideration for privacy-conscious users or organizations with strict data policies. Its design aims to balance robust feature coverage with a simple setup process, typically involving a Docker image so you can start using the toolkit with minimal configuration. ... -
2
Vince's CSV Parser
A modern C++ library for reading, writing, and analyzing CSV
...Inspired by Python's csv module, I wanted a library with simple, intuitive syntax. Furthermore, I wanted support for special use cases such as calculating statistics on very large files. With the deluge of large datasets available, a performant CSV parser is a necessity. By using overlapped threads, memory-mapped IO, and efficient data structures, this parser can quickly tackle large CSV files. Furthermore, this parser has a minimal memory footprint and can handle larger-than-RAM files. -
3
JSON Hero
JSON Hero is an open-source, beautiful JSON explorer for the web
JSON Hero is a beautiful and powerful JSON viewer designed for developers who work with large and complex JSON files. It runs as a web-based interface (and as a standalone app) that provides semantic, interactive rendering of JSON content, helping users understand the structure and meaning of data at a glance. JSON Hero automatically detects data types such as URLs, dates, colors, and base64 images, and presents them in meaningful ways. -
4
Readr
Read flat files (csv, tsv, fwf) into R
readr is an R package that provides a fast and friendly way to read rectangular data, such as CSV and TSV files. Part of the Tidyverse, it simplifies data import and parsing tasks in R. -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
League CSV
CSV data manipulation made easy in PHP
The PHP League CSV is a PHP library for reading, writing, and manipulating CSV files. It offers a straightforward API for handling common CSV operations, including parsing data, writing rows, and formatting output. The library is designed to handle large datasets efficiently, making it a reliable choice for data processing tasks in web applications. -
6
dvisvgm
A fast DVI, EPS, and PDF to SVG converter
The command-line utility dvisvgm is a tool for TEX/LATEX users. It converts DVI, EPS, and PDF files to the XML-based vector graphics format SVG. In contrast to bitmap graphics, vector graphics are arbitrarily scalable without loss of quality. All modern web browsers support a large amount of the current SVG standard 1.1. Furthermore, SVG files can also be displayed with the Java-based Squiggle SVG browser which is part of the Apache Batik project, and the free vector graphics editor Inkscape. -
7
QSV
Blazing-fast Data-Wrangling toolkit
qsv is a fast, command-line CSV data toolkit written in Rust that extends the capabilities of xsv. It’s designed to make working with CSV files at scale easy and efficient, offering over 40 powerful subcommands for tasks like querying, sampling, splitting, deduplicating, and more. qsv is ideal for data engineers, analysts, and developers who need high-performance CSV manipulation on the command line. -
8
log4rs
A highly configurable logging framework for Rust
...If you are using the file rotation in your configuration there is a known substantial performance issue so listen up! By default the gzip feature is enabled and when rolling files it will zip log archives automatically. This is a problem when the log archives are large as the zip happens in the main thread and will halt the process while the zip is completed. Be advised that the gzip feature will be removed from default features as of 1.0. -
9
srsly
Modern high-performance serialization utilities for Python
...Currently supports JSON, JSONL, MessagePack, Pickle, and YAML. Serialization is hard, especially across Python versions and multiple platforms. After dealing with many subtle bugs over the years (encodings, locales, large files) our libraries like spaCy and Prodigy have steadily grown a number of utility functions to wrap the multiple serialization formats we need to support (especially json, msgpack and pickle). These wrapping functions ended up duplicated across our codebases, so we wanted to put them in one place. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
Miller
Miller is like awk, sed, cut, join, and sort for name-indexed data
Miller is like awk, sed, cut, join, and sort for data formats such as CSV, TSV, JSON, JSON Lines, and positionally-indexed. With Miller, you get to use named fields without needing to count positional indices, using familiar formats such as CSV, TSV, JSON, JSON Lines, and positionally-indexed. Then, on the fly, you can add new fields which are functions of existing fields, drop fields, sort, aggregate statistically, pretty-print, and more. Miller operates on key-value-pair data while the... -
11
lowdb
Small local JSON database powered by Lodash
...It supports Node, the browser and uses lodash API, so it's very simple to learn. Actually, if you know Lodash, you already know how to use lowdb. lowdb doesn't support Cluster and may have issues with very large JSON files (~200MB). A UMD build is also available on unpkg for testing and quick prototyping. Database lodash instance. Use it to add your own utility functions or third-party mixins like underscore-contrib or lodash-id. With lowdb, you get access to the entire lodash API, so there are many ways to query and manipulate data. -
12
CSV to JSON
Blazing fast and Comprehensive CSV Parser for Node.JS
A Node.js library that converts CSV files into JSON format efficiently, supporting large files and advanced parsing. -
13
Papa Parse
CSV parser that handles large files and malformed input
The world's first multi-threaded CSV parser for the browser. Use Papa when performance, privacy, and correctness matter to you. Papa alleviates privacy concerns related to uploading files. Malformed CSV is handled gracefully with a detailed error report. Now the fastest JavaScript CSV parser for the browser. Papa can handle files gigabytes in size without crashing. CSV to JSON and JSON to CSV. Auto-detect delimiter, open local files, download remote files, stream local and remote files,... -
14
SimpleXlsxWriter
C++ library for creating XLSX files for MS Excel 2007 and above.
This library represents XLSX files writer for Microsoft Excel 2007 and above. The main feature of this library is that it uses C++ standard file streams. On the one hand it results in almost unnoticeable memory and CPU resources consumption while processing (that may be very useful at saving a large data arrays), but on the other hand it makes unfeasible to edit data that were written. -
15
HTML Viewer Components for Delphi, Lazarus and C++Builder The HtmlViewer component set consists of the THtmlViewer, TFrameViewer, and TFrameBrowser components. All three are HTML document display components: THtmlViewer * The basic component. * THtmlViewer displays single (non-frame) documents. * It also forms the basis for the other two components. TFrameViewer * Displays both frame and single HTML documents. * TFrameViewer is oriented more for local file system...
-
16
Tile Pattern Exporter
Tile large format PNG patterns into print-at-home PDF pages
You can tile large format PNG patterns into print-at-home PDF pages. Created for LearnMYOG. This set of scripts automates the tiling of large format PNG files into letter(A4), tabloid(A3), and A0 sized PDF pages with print margins, alignment and cut guides, page numbers, and a copyright stamp to each page. For best results, input an exported PNG with size in multiples of 7.5 inches wide and 10 inches tall @ 300dpi. -
17
vscode-data-preview
Extension for importing, viewing, slicing, dicing, and charting JSON
Data Preview extension for importing, viewing, slicing, dicing, charting & exporting large .json array .arrow .avro .parquet data files, .config .env .properties .ini .yml configurations files, .csv/.tsv & .xlsx/.xlsb Excel files and .md markdown tables with Perspective - streaming data analytics WebAssembly library. -
18
Free VCF file to CSV or Excel converter
Excel VBA Script to convert VCF file with multiple entries to CSV file
This is an Excel based VBA script used to import bulk .VCF files that contain more than 1 Vcard and then convert them to a comma separated .CSV file or Excel xls file that can then be imported into Outlook, Google, or any other application that supports import of contacts using CSV files. This has been written to support VCF 2.0, 2.1, 3.0 and 4.0 formatted files including those with printable encoding (MIME) and has been tested with bulk VCF files from Backupify, Google Contacts (Gmail... -
19
javahexeditor Java Hex Editor
A hex editor Eclipse plugin and multi-platform desktop application
You can install the latest Eclipse plugin version from the update site https://javahexeditor.sourceforge.io/update or the Eclipse Marketplace https://marketplace.eclipse.org/content/java-hex-editor. Older versions of the Eclipse plugin are available via the update site for the version, e.g. https://javahexeditor.sourceforge.io/update/0.5.1 You can download the latest stand-alone version and older versions on the "Files" tab. -
20
jtc
JSON processing utility
jtc stand for: JSON transformational chains (used to be JSON test console). jtc offers a powerful way to select one or multiple elements from a source JSON and apply various actions on the selected elements at once (wrap selected elements into a new JSON, filter in/out, sort elements, update elements, insert new elements, remove, copy, move, compare, transform, swap around and many other operations). -
21
WikiSQL
A large annotated semantic parsing corpus for developing NL interfaces
A large crowd-sourced dataset for developing natural language interfaces for relational databases. WikiSQL is the dataset released along with our work Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning. Regarding tokenization and Stanza, when WikiSQL was written 3-years ago, it relied on Stanza, a CoreNLP python wrapper that has since been deprecated. If you'd still like to use the tokenizer, please use the docker image. We do not anticipate switching... -
22
Xml2Json Converter
Simple tool for converting large XML-files to JSON or JSON to XML
Simple converter tool with GUI (written on JavaFX) for converting large XML-files to JSON and JSON to XML with indicating progress and uses small amount of memory for converting. Starting from 1.2.0 application supports batch converting files from directory by pattern. Uses Java 1.8+ (http://www.oracle.com/technetwork/java/javase/downloads/jre8-downloads-2133155.html). Distributions for Mac, Linux and Windows already have embedded JRE, so just download appropriate distribution and start application. -
23
biweekly
An iCalendar library written in Java.
biweekly HAS MOVED TO GITHUB! Watch me, star me, fork me! https://github.com/mangstadt/biweekly biweekly is an iCalendar library written in Java (requires Java 1.5 or above). The project aims to provide a well documented, easy to use API for reading and writing iCalendar and vCalendar data. -
24
libznz with zindex
This is a fast version of libznz used in NIfTI C library
This library provides notable speed-up for seeking in large compressed NIfTI files. It is compatible with the libznz interface which is part of NIfTI C library to handle multidimensional (mostly MRI) images. Only the replacement of the currently available libznz library is necessary. To reach the expected speed-up the compressed NIfTI data has to be indexed with the included tool. -
25
PHDL
An HDL alternative to PCB graphical schematic capture tools.
PHDL is an HDL that functions as an alternative to mainstream graphical schematic capture tools. The language is compiled into a pcb netlist which can then be imported into a layout tool. We are currently on version 2.1 of the tool. We have created an eclipse plugin version of the tool as well as a standalone command-line based version. Both function identically and output a netlist that can be imported into a pcb layout tool. VHDL revolutionized how FPGA designs and digital logic...
