Search Results for "data processing"
Sort By:
Showing 23 open source projects for "data processing"
View related business solutions-
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI. Switch between models without switching platforms.
-
1
Miller
Miller is like awk, sed, cut, join, and sort for name-indexed data
Miller is like awk, sed, cut, join, and sort for data formats such as CSV, TSV, JSON, JSON Lines, and positionally-indexed. With Miller, you get to use named fields without needing to count positional indices, using familiar formats such as CSV, TSV, JSON, JSON Lines, and positionally-indexed. Then, on the fly, you can add new fields which are functions of existing fields, drop fields, sort, aggregate statistically, pretty-print, and more. Miller operates on key-value-pair data while the... -
2
jq
Lightweight and flexible command-line JSON processor
jq is like sed for JSON data - you can use it to slice, filter, map and transform structured data with the same ease that sed, awk, grep and friends let you play with text. jq is written in portable C, and it has zero runtime dependencies. You can download a single binary, scp it to a far away machine of the same type, and expect it to work. jq can mangle the data format that you have into the one that you want with very little effort, and the program to do so is often shorter and simpler... -
3
JOSE JWT
Ultimate Javascript Object Signing and Encryption (JOSE)
Minimalistic zero-dependency library for generating, decoding, and encryption JSON Web Tokens. Supports full suite of JSON Web Algorithms and Json Web Keys. JSON parsing agnostic can plug any desired JSON processing library. Extensively tested for compatibility with jose.4.j, Nimbus-JOSE-JWT, and json-jwt libraries. JWE JSON Serialization cross-tested with JWCrypto. -
4
ojg
Optimized JSON for Go
Optimized JSON for Go is a high-performance parser with a variety of additional JSON tools. OjG is optimized to processing huge data sets where data does not necessarily conform to a fixed structure. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
encoding
Go package containing implementations of efficient encoding
Go package containing implementations of encoders and decoders for various data formats. At Segment, we do a lot of marshaling and unmarshaling of data when sending, queuing, or storing messages. The resources we need to provision on the infrastructure are directly related to the type and amount of data that we are processing. At the scale we operate at, the tools we choose to build programs can have a large impact on the efficiency of our systems. -
6
getty
Asynchronous network I/O library
Getty is an asynchronous network I/O library developed in Golang. It operates on TCP, UDP, and WebSocket network protocols, providing a consistent interface EventListener. Within Getty, each connection (session) involves two separate goroutines. One handles the reading of TCP streams, UDP packets, or WebSocket packages, while the other manages the logic processing and writes responses into the network write buffer. If your logic processing might take a considerable amount of time, it's... -
7
Biome
A toolchain for web projects, aimed to provide functionalities
Biome formats and lints your code in a fraction of a second. Biome supports JavaScript, TypeScript, JSON, and CSS. It aims to support all main languages of modern web development. Biome has sane defaults and requires minimal configuration. Biome helps you as much as possible by displaying detailed and contextualized diagnostics. Biome unifies functionality that has previously been separate tools. Building upon a shared base allows us to provide a cohesive experience for processing code,... -
8
fast-xml-parser
Validate XML, Parse XML and Build XML rapidly
Validate XML, Parse XML to JS Object, or Build XML from JS Object without C/C++ based libraries and no callback. -
9
Roarr
JSON logger for Node.js and browser
JSON logger for Node.js and browser. A transport in most logging libraries is something that runs in-process to perform some operation with the finalized log line. For example, a transport might send the log line to a standard syslog server after processing the log line and reformatting it. Roarr does not support in-process transports because Node processes are single threaded processes (ignoring some technical details). Given this restriction, Roarr purposefully offloads handling of the... -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
StringZilla
10x faster string search, split, sort, and shuffle for long strings
StringZilla is the Godzilla of string libraries, splitting, sorting, and shuffling large textual datasets. StringZilla uses a heuristic so simple it's almost stupid... but it works. It matches the first few letters of words with hyper-scalar code to achieve memcpy speeds. The implementation fits into a single C 99 header file and uses different SIMD flavors and SWAR on older platforms. The Str is designed to replace long Python str strings and wrap our C-level API. On the other hand, the... -
11
jaq
A jq clone focussed on correctness, speed, and simplicity
jaq (pronounced like Jacques) is a clone of the JSON data processing tool jq. jaq aims to support a large subset of jq's syntax and operations. Jaq aims to provide a more correct and predictable implementation of jq, while preserving compatibility with jq in most cases. -
12
JC
CLI tool and python library
...This allows piping of output to tools like jq and simplifying automation scripts. jc JSONifies the output of many CLI tools and file types for easier parsing in scripts. This allows further command-line processing of output with tools like jq or jello by piping commands. The JC parsers can also be used as python modules. In this case, the output will be a python dictionary, or a list of dictionaries, instead of JSON. Two representations of the data are available. The default representation uses a strict schema per parser and converts known numbers to int/float JSON values. ... -
13
HCL
HCL is the HashiCorp configuration language
HCL is a toolkit for creating structured configuration languages that are both human- and machine-friendly, for use with command-line tools. Although intended to be generally useful, it is primarily targeted toward DevOps tools, servers, etc. HCL has both a native syntax, intended to be pleasant to read and write for humans, and a JSON-based variant that is easier for machines to generate and parse. It includes an expression syntax that allows basic inline computation and, with support from... -
14
gSOAP Toolkit
Development toolkit for Web Services and XML data bindings for C & C++
The gSOAP toolkit is an extensive suite of portable C and C++ software to develop XML Web services with powerful type-safe XML data bindings. Easy-to-use code-generator tools allow you to directly integrate XML data in C and C++. Serializes native application data in XML. Includes WSDL/XSD schema binding and auto-coding tools, stub/skeleton compiler, Web server integration with Apache module and IIS extension, high-performance XML processing with schema validation, fast MIME/MTOM streaming, SOAP and REST Web API development, WS-* protocols (WS-Security, WS-Policy, WS-ReliableMessaging, etc), XML-RPC and JSON. ... -
15
xsd2pgschema
Relational database replication tool based on XML Schema
xsd2pgschema is a Java application suite, which converts XML Schema 1.1 (hierarchical data model) to PostgreSQL DDL (relational data model) and supports XML data migration into PostgreSQL based on the XML Schema without defects on information content. It also supports full-text indexing via either Apache Lucene or Sphinx Search utilizing the relational data model. File conversion from XML to CSV, TSV, or JSON is possible as well as mapping XML Schema to JSON Schema. Obtained PostgreSQL... -
16
The YALTools is a set of command line tools written in ruby for CouchDB. It provides a unix like command set, mkdb, rmdb, lsdbs, lsdocs, putdocs, csv2json, and more. It aims to provide a power of filters and pipes in *NIX environment.
-
17
Problems for Spring MVC
A library for handling Problems in Spring Web MVC
Problem Spring Web is a set of libraries that makes it easy to produce application/problem+json responses from a Spring application. It fills a niche, in that it connects the Problem library and either Spring Web MVC's exception handling or Spring WebFlux's exception handling so that they work seamlessly together, while requiring minimal additional developer effort. In doing so, it aims to perform a small but repetitive task — once and for all. -
18
jtc
JSON processing utility
jtc stand for: JSON transformational chains (used to be JSON test console). jtc offers a powerful way to select one or multiple elements from a source JSON and apply various actions on the selected elements at once (wrap selected elements into a new JSON, filter in/out, sort elements, update elements, insert new elements, remove, copy, move, compare, transform, swap around and many other operations). -
19
XML - JMS/JSON
Converter utility between XML text and Javascript object / JSON text
Convert XML text to Javascript object / JSON text (and vice versa). Can parse: elements, attributes, texts, comments, CData, DOCTYPE, XML declarations, and Processing Instructions. Usually, the output of XML attributes are stored in @attr, _atrr, $attr, or $ in order to avoid conflicting with the name of sub-elements. This library stores them in attributes, but most importantly, you can change this to whatever you like. -
20
jsondata
Modular JSON by trees and branches, pointers and patches
The 'jsondata' package provides for the modular in-memory processing of JSON data by trees, branches, pointers, and patches. The main interface classes are: - JSONData - Core for RFC7159 based data structures. Provides modular data components. - JSONDataSerializer - Core for RFC7159 based data persistence. Provides modular data serialization. - JSONPointer - RFC6901 for addressing by pointer paths. -
21
Dictionary
A JSON representation of Webster's Unabridged Dictionary
...The project offers a simple interface for retrieving definitions programmatically, making it useful for applications that require dictionary or vocabulary functionality. It is designed to be straightforward, enabling developers to quickly integrate dictionary lookups without heavy dependencies. Since it relies on WordNet data, it provides accurate and widely accepted definitions. The repository also includes usage examples that demonstrate how to incorporate the module into JavaScript projects. As an open source utility, dictionary can be extended or customized to suit different natural language processing or educational applications. -
22
Jigy Generator Windows
The best way to generate a Spring Java Web Application. It just works!
The Jigy Generator is the simplest way to build and code a Java web application with a Spring Framework by using a project creation wizard and now it's been made even simpler by downloading a very small HTML file (337 bytes) and filling out a few form fields and let it construct your project with ease! The resulting project will be a Java web application with a Spring Framework configured to run in Eclipse or Netbeans. The project is annotation-based and provides dependency injection of... -
23
A javascript templating toolkit that allows on-demand asynchronous dependencies loading (= html/css/js/other files ) for a given screen element, and automates template processing and display. It acts like a multitasking browser environment.
- Previous
- You're on page 1
- Next
