Open Source Rust Data Formats Software
Sort By:
Rust Data Formats Software
View related business solutionsBrowse free open source Rust Data Formats Software and projects below. Use the toggles on the left to filter open source Rust Data Formats Software by OS, license, language, programming language, and project status.
-
$300 in Free Credit Towards Top Cloud ServicesStart your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
-
Stop Storing Third-Party Tokens in Your DatabaseRolling your own OAuth token storage can be a security liability. Token Vault securely stores access and refresh tokens from federated providers and handles exchange and renewal automatically. Connected accounts, refresh exchange, and privileged worker flows included.
-
1
QSV
Blazing-fast Data-Wrangling toolkit
qsv is a fast, command-line CSV data toolkit written in Rust that extends the capabilities of xsv. It’s designed to make working with CSV files at scale easy and efficient, offering over 40 powerful subcommands for tasks like querying, sampling, splitting, deduplicating, and more. qsv is ideal for data engineers, analysts, and developers who need high-performance CSV manipulation on the command line. -
2
Cube
Universal semantic layer platform for AI, BI, spreadsheets
Cube is the semantic layer for building data applications. It helps data engineers and application developers access data from modern data stores, organize it into consistent definitions, and deliver it to every application. Cube was designed to work with all SQL-enabled data sources, including cloud data warehouses like Snowflake or Google BigQuery, query engines like Presto or Amazon Athena, and application databases like Postgres. Cube has a built-in relational caching engine to provide sub-second latency and high concurrency for API requests. -
3
Vortex
The LLVM of columnar file formats
Vortex is a high-performance toolkit designed for working with compressed Apache Arrow arrays, providing functionality for in-memory, on-disk, and over-the-wire data handling. It aims to be an advanced successor to Apache Parquet, offering dramatically faster random access reads and scans, while maintaining similar compression ratios. Vortex's modular design allows for extensibility, enabling developers to implement custom encodings for efficient data management, particularly for large-scale columnar datasets. -
4
Biome
A toolchain for web projects, aimed to provide functionalities
Biome formats and lints your code in a fraction of a second. Biome supports JavaScript, TypeScript, JSON, and CSS. It aims to support all main languages of modern web development. Biome has sane defaults and requires minimal configuration. Biome helps you as much as possible by displaying detailed and contextualized diagnostics. Biome unifies functionality that has previously been separate tools. Building upon a shared base allows us to provide a cohesive experience for processing code, displaying errors, parallelizing work, caching, and configuration. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
LOL HTML
Low output latency streaming HTML parser/rewriter with CSS API
Low Output Latency streaming HTML rewriter/parser with CSS-selector based API. It is designed to modify HTML on the fly with minimal buffering. It can quickly handle very large documents, and operate in environments with limited memory resources. The crate serves as a back-end for the HTML rewriting functionality of Cloudflare Workers, but can be used as a standalone library with a convenient API for a wide variety of HTML rewriting/analysis tasks. The parser switches back to the tag scanner as soon as input leaves the scope of all selector matches. The tag scanner may also sometimes switch the parser to the Lexer - if it requires additional tag information for the parsing feedback simulation. Having two different parser implementations for the same grammar will increase development costs and is error-prone due to implementation inconsistencies. We minimize these risks by implementing a small Rust macro-based DSL which is similar in spirit to Ragel. -
6
serde_with
This crate provides custom de/serialization helpers
This crate provides custom de/serialization helpers to use in combination with serde's with-annotation and with the improved serde_as-annotation. -
7
TexLab
An implementation of the Language Server Protocol for LaTeX
A cross-platform implementation of the Language Server Protocol providing rich cross-editing support for the LaTeX typesetting system. The server may be used with any editor that implements the Language Server Protocol. -
8
fastn
(Alpha stage software) fastn - Full-stack Web Development Made Easy
ftd is a programming language for building user interfaces and content-centric websites. ftd is easy to learn, especially for nonprogrammers, but it does not compromise on what you can build with it. fastn is a web framework, a content management system, and an integrated development environment for ftd. fastn is a web server, that compiles ftd to HTML/CSS/JS and can be deployed on your server, or on fastn cloud by FifthTry. ftd is designed with minimal and uniform syntax, and at first glance does not even look like a programming language. -
9
jaq
A jq clone focussed on correctness, speed, and simplicity
jaq (pronounced like Jacques) is a clone of the JSON data processing tool jq. jaq aims to support a large subset of jq's syntax and operations. Jaq aims to provide a more correct and predictable implementation of jq, while preserving compatibility with jq in most cases. -
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
10
jless
jless is a command-line JSON viewer designed for reading
jless is a command-line JSON viewer. Use it as a replacement for whatever combination of less, jq, cat and your editor you currently use for viewing JSON files. It is written in Rust and can be installed as a single standalone binary. Clean syntax highlighted display of JSON data, omitting quotes around object keys, closing object and array delimiters, and trailing commas. Expand and collapse objects and arrays so you can see both the high- and low-level structure of the data. -
11
log4rs
A highly configurable logging framework for Rust
log4rs is a highly configurable logging framework modeled after Java's Logback and log4j libraries. If you are using the file rotation in your configuration there is a known substantial performance issue so listen up! By default the gzip feature is enabled and when rolling files it will zip log archives automatically. This is a problem when the log archives are large as the zip happens in the main thread and will halt the process while the zip is completed. Be advised that the gzip feature will be removed from default features as of 1.0. -
12
quick-xml
Rust high performance xml reader and writer
High-performance xml pull reader/writer. The reader is almost zero-copy (use of Cow whenever possible) It is easy on memory allocation (the API provides a way to reuse buffers) It supports various encoding (with encoding feature), namespaces resolution, and special characters. Syntax is inspired by xml-rs. When using the serialize feature, quick-xml can be used with serde's Serialize/Deserialize traits. The mapping between XML and Rust types, and in particular the syntax that allows you to specify the distinction between elements and attributes, is described in detail in the documentation for deserialization. -
13
Crossbeam
Tools for concurrent programming in Rust
This crate provides a set of tools for concurrent programming. Crossbeam supports stable Rust releases going back at least six months, and every time the minimum supported Rust version is increased, a new minor version is released. Currently, the minimum supported Rust version is 1.36. Crossbeam welcomes contribution from everyone in the form of suggestions, bug reports, pull requests, and feedback. We also have the RFCs repository for more high-level discussion, which is the place where we brainstorm ideas and propose substantial changes to Crossbeam. If you'd like to learn more about concurrency and non-blocking data structures, there's a list of learning resources in our wiki, which includes relevant blog posts, papers, videos, and other similar projects. The Crossbeam project adheres to the Rust Code of Conduct. This describes the minimum behavior expected from all contributors. -
14
Crowbook
Converts books written in Markdown to HTML, LaTeX/PDF and EPUB
Crowbook's aim is to allow you to write a book in Markdown without worrying about formatting or typography and let the program generate HTML, PDF and EPUB output for you. Its focus is novels and fiction, and the default settings should (hopefully) generate readable books with correct typography without requiring you to worry about it. To see what Crowbook's output looks like, you can read the Crowbook guide rendered in HTML, PDF or EPUB. Crowbook will parse this file and generate HTML, EPUB, and/or PDF output formats, according to the settings in the configuration file. Crowbook supports HTML, PDF and EPUB (either version 2 or 3) as output formats. See the Crowbook User Guide rendered in HTML, EPUB and PDF. Crowbook uses pulldown-cmark and thus should support most of CommonMark Markdown. -
15
Crowbook LaTeX
Converts books written in Markdown to HTML, LaTeX/PDF and EPUB
Crowbook's aim is to allow you to write a book in Markdown without worrying about formatting or typography and let the program generate HTML, PDF and EPUB output for you. Its focus is novels and fiction, and the default settings should (hopefully) generate readable books with correct typography without requiring you to worry about it. -
16
Grin
Minimal implementation of the Mimblewimble protocol
Grin is an in-progress implementation of the Mimblewimble protocol. Grin is a privacy-preserving digital currency built openly by developers and distributed all over the world. Grin has no amounts and no addresses. Transactions can be trivially aggregated. To hide the origin of a newly created transaction, it gets relayed among a sub-set of peers before it is widely broadcasted. Electronic transactions for all. Without censorship or restrictions. Designed for the decades to come, not just for tomorrow. To be used by anyone, anywhere. Grin is not controlled by any company, foundation, or individual. The coin distribution is designed to be as fair as possible, with emission of 1 GRIN per second. Mimblewimble leverages cryptography to allow past transaction data to be removed with no compromise on security. This avoids Grin collapsing under the weight of data having to be kept on-chain. -
17
Pikkr
JSON parser to pick up values directly without performing tokenization
JSON Parser which picks up values directly without performing tokenization in Rust. Pikkr is a JSON parser that picks up values directly without performing tokenization in Rust. Creates an index which maps logical locations of queried fields to their physical locations by using SIMD instructions and bit manipulation. Finds values of queried fields by scanning a JSON record using the index created in the previous process and learns their logical locations (i.e. pattern of the JSON structure) in the early stages. Speculates logical locations of queried fields by using the learned result information, jumps directly to their physical locations and extracts values in the later stages. Fallbacks to basic parsing if the speculation fails. -
18
RedisJSON
RedisJSON - a JSON data type for Redis
RedisJSON is a Redis module that implements ECMA-404 The JSON Data Interchange Standard as a native data type. It allows storing, updating and fetching JSON values from Redis keys (documents). -
19
Serde JSON
Strongly typed JSON library for Rust
Serde is a framework for serializing and deserializing Rust data structures efficiently and generically. -
20
hq for HTML
jq, but for HTML
jq, but for HTML. hq reads HTML and converts it into a JSON object based on a series of CSS selectors. The selectors are expressed in a similar way to JSON, but where the values are CSS selectors. -
21
jql
A JSON Query Language CLI tool
jql is a JSON Query Language tool built with Rust. -
22
json-rust
JSON implementation in Rust
Parse and serialize JSON with ease. JSON is a very loose format where anything goes - arrays can hold mixed types, object keys can change types between API calls or not include some keys under some conditions. Mapping that to idiomatic Rust structs introduces friction. -
23
jwt-cli
A super fast CLI tool to decode and encode JWTs built in Rust
A super-fast CLI tool to decode and encode JWTs built in Rust. jwt-cli is a command line tool to help you work with JSON Web Tokens (JWTs). Like most JWT command line tools out there, you can decode almost any JWT header and claims body. Unlike any that I've found, however, jwt-cli allows you to encode a new JWT with nearly any piece of data you can think of. Custom header values (some), custom claim bodies (as long as it's JSON, it's game), and using any secret you need. -
24
mdBook-KaTeX
Preprocessor for mdBook, rendering LaTex equations to HTML
mdBook-KaTeX is a preprocessor for mdBook, using KaTeX to render LaTeX math expressions. A preprocessor for mdBook, rendering LaTex equations to HTML at build time. -
25
rq
A tool for doing record analysis and transformation
This is the home of the tool called rq (record query). It's a tool that's used for performing queries on streams of records in various formats. The goal is to make ad-hoc exploration of data sets easy without having to use more heavy-weight tools like SQL/MapReduce/custom programs. rq fills a similar niche as tools like awk or sed, but works with structured (record) data instead of text. It was created with love out of the best parts of Rust, and is distributed as a dependency-free binary on many operating systems and architectures.
