Search Results for "byte on"
Sort By:
Showing 241 open source projects for "byte on"
View related business solutions-
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI. Switch between models without switching platforms.
-
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
1
minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm
minbpe is a minimal, clean implementation of byte-level Byte Pair Encoding (BPE), the tokenization approach widely used in modern language models. It operates on UTF-8 encoded bytes rather than Unicode characters, which makes it robust to arbitrary text inputs and avoids needing a language-specific character vocabulary. The repository is structured as a teaching-oriented implementation that shows how to train a tokenizer by learning merge rules, then apply those merges to encode text into token IDs and decode tokens back into text. ... -
2
Zerocopy
Zerocopy makes zero-cost memory manipulation effortless
Zerocopy is a Rust library designed to make zero-cost memory manipulation both safe and effortless. It allows developers to reinterpret or convert raw byte sequences into structured types—and vice versa—without writing unsafe code directly. The crate provides safe abstractions for transmuting data while preserving Rust’s strict safety guarantees, removing the need for manual memory manipulation. Zerocopy introduces a suite of conversion traits such as TryFromBytes, FromBytes, IntoBytes, and FromZeros for defining how types can be safely constructed from or written to byte sequences. ... -
3
JSON implementation for Ruby
JSON implementation for Ruby
...If an:ascii_only option with a true value is given, they escape all non-ASCII and control characters with \uXXXX escape sequences, and support UTF-16 surrogate pairs in order to be able to generate the whole range of Unicode code points. All strings, that are to be encoded as JSON strings, should be UTF-8 byte sequences on the Ruby side. To encode raw binary strings, that aren't UTF-8 encoded, please use the to_json_raw_object method of String (which produces an object, that contains a byte array) and decode the result on the receiving endpoint. -
4
Shelf
Web server middleware for Dart
...Map server logic into a simple function: a single argument for the request, the response is the return value. Trivially mix and match synchronous and asynchronous processing. Flexibility to return a simple string or a byte stream with the same model. An adapter must handle all errors from the handler, including the handler returning a null response. It should print each error to the console if possible, then act as though the handler returned a 500 response. The adapter may include body data for the 500 response, but this body data must not include information about the error that occurred. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
ImHex
A Hex Editor for Reverse Engineers, Programmers
...Such features are a completely custom binary template and pattern language to decode and highlight structures in the data, a graphical node-based data processor to pre-process values before they're displayed, a disassembler, diffing support, bookmarks and much much more. At the same time ImHex is completely free and open source under the GPLv2 license. Byte patching, patch management, Copy-Bytes-As-Array for many common programming languages, string and hex search, Bookmarks, Goto, Huge file support, variable column count, custom encodings and much more. ImHex includes a full custom C++-like pattern language that allows easy highlighting, decoding and analyzing of file formats. -
6
cookie
HTTP server cookie parsing and serialization
...Since the value of a cookie has a limited character set (and must be a simple string), this function can be used to decode a previously-encoded cookie value into a JavaScript string or other object. The default function is the global decodeURIComponent, which will decode any URL-encoded sequences into their byte representations. -
7
Akavache
An asynchronous, persistent key-value store
...Akavache is a library that makes common app patterns easy, and unifies caching of different object types (i.e. HTTP responses vs. JSON objects vs. images). It's built on a core key-value byte array store (conceptually similar to a Dictionary<string, byte[]>), and on top of that store, extensions are added to support Arbitrary objects via JSON.NET. -
8
RSocket
Java implementation of RSocket
Application protocol providing Reactive Streams semantics. RSocket provides a protocol for Reactive Streams semantics between client-server, and server-server communication. RSocket is a binary protocol for use on byte stream transports such as TCP, WebSockets, and Aeron. RSocket is intended to be consumed via one of the various implementation libraries which implement the RSocket Protocol. By default to make RSocket easier to use it copies the incoming Payload. Copying the payload comes at cost to performance and latency. If you want to use zero copy you must disable this. ... -
9
rsocket-kotlin
RSocket Kotlin multi-platform implementation
RSocket provides a protocol for Reactive Streams semantics between client-server, and server-server communication. RSocket is a binary protocol for use on byte stream transports such as TCP, WebSockets, and Aeron. RSocket is intended to be consumed via one of the various implementation libraries which implement the RSocket Protocol. -
Add Two Lines of Code. Get Full APM.Works out of the box for Rails, Django, Express, Phoenix, and more. Monitoring exceptions and performance in no time.
-
10
berry
A healthy, byte-sized window manager
A healthy, bite-sized window manager written in C over the XLib library. Controlled via a powerful command-line client, allowing users to control windows via a hotkey daemon such as sxhkd or expand functionality via shell scripts. -
11
JerryScript
Ultra-lightweight JavaScript engine for the Internet of Things
JerryScript is a lightweight JavaScript engine for resource-constrained devices such as microcontrollers. It can run on devices with less than 64 KB of RAM and less than 200 KB of flash memory. -
12
SentencePiece
Unsupervised text tokenizer for Neural Network-based text generation
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing. Purely data driven, sentencePiece trains tokenization and detokenization models from sentences. ... -
13
Cloud Torrent
Cloud Torrent, a self-hosted remote torrent client
...As long as it has a concept of files and folders, it could potentially be a cloud-torrent file-system backend. During a file tranfer, one could apply different transforms against the byte stream for various effect. -
14
markdown-rs
CommonMark compliant markdown parser in Rust with ASTs and extensions
markdown-rs is an open-source markdown parser written in Rust. It’s implemented as a state machine (#![no_std] + alloc) that emits concrete tokens, so that every byte is accounted for, with positional info. The API then exposes this information as an AST, which is easier to work with, or it compiles directly to HTML. While most markdown parsers work towards compliancy with CommonMark (or GFM), this project goes further by following how the reference parsers (cmark, cmark-gfm) work, which is confirmed with thousands of extra tests. ... -
15
Fast Binary Encoding (FBE)
Fast Binary Encoding is fast and universal serialization solution
Fast Binary Encoding is ultra fast and universal serialization solution for C++, C#, Go, Java, JavaScript, Kotlin, Python, Ruby, and Swift. Fast Binary Encoding allows to description of any domain models, business objects, complex data structures, client/server requests & responses and generate native code for different programming languages and platforms. -
16
PINCache
Fast, non-deadlocking parallel object cache for iOS, tvOS and OS X
...On iOS, PINMemoryCache will clear itself when the app receives a memory warning or goes into the background. Objects stored in PINDiskCache remain until you trim the cache yourself, either manually or by setting a byte or age limit. -
17
INI
Package ini provides INI file read and write functionality in Go
The most powerful, convenient and popular Go package for INI manipulations existed on Earth. Not limited to reading from a file, parse from []byte type raw data, or streaming from io.ReadCloser works like a charm. Wide-range support of variant formats includes but is not limited to my.cnf, .gitconfig, or even unparseable sections. Automatically convert to native types of Go at no cost. Let you focus on the code logic and no more tedious conversions. Map your configuration to a user-defined struct{} to be more object-oriented. ... -
18
LiteNetLib 1.0 indev
Lite reliable UDP library for Mono and .NET
Lite reliable UDP library for .NET Framework 3.5, Mono, .NET Core 2.0, .NET Standard 2.0. Small packet size overhead (1 byte for unreliable, 3 bytes for reliable packets). Helper classes for sending and reading messages. Always use library sources instead of precompiled DLL files (because there are platform-specific #ifdefs and workarounds for unity bugs). Fast packet serializer (Usage manual). Automatic small packets merging. Automatic fragmentation of reliable packets. -
19
Vince's CSV Parser
A modern C++ library for reading, writing, and analyzing CSV
There's plenty of other CSV parsers in the wild, but I had a hard time finding what I wanted. Inspired by Python's csv module, I wanted a library with simple, intuitive syntax. Furthermore, I wanted support for special use cases such as calculating statistics on very large files. With the deluge of large datasets available, a performant CSV parser is a necessity. By using overlapped threads, memory-mapped IO, and efficient data structures, this parser can quickly tackle large CSV files.... -
20
GJSON
Get JSON values quickly, JSON parser for Go
GJSON is a Go library designed for extremely fast, allocation-free retrieval of values from JSON documents. It enables you to query nested JSON structures using one-liner dot-notation or array-based paths and includes wildcard and comparison operators. The library is optimized for speed and zero allocations, benchmarking significantly faster than Go’s standard encoding/json unmarshal approaches. It supports parsing JSON lines (newline-delimited JSON) as an array for large stream processing.... -
21
django-rest-framework-gis
Geographic add-ons for Django REST Framework
...This field handles GeoDjango geometry fields, providing custom to_native and from_native methods for GeoJSON input/output. While precision and remove_duplicates are designed to reduce the byte size of the API response, they will also increase the processing time required to render the response. This will likely be negligible for small GeoJSON responses but may become an issue for large responses. The primary key of the model (usually the "id" attribute) is automatically used as the id field of each GeoJSON Feature Object. ... -
22
XiangShan
Open-source high-performance RISC-V processor
XiangShan is an open-source, high-performance RISC-V processor project that implements out-of-order superscalar cores using Chisel for hardware construction. The design targets modern performance goals—deep pipelines, speculative execution, multi-issue decode/execute, and sophisticated branch prediction—while remaining synthesizable for ASIC flows and portable to FPGAs for research. A modular microarchitecture separates frontend, backend, and memory subsystems with coherent caches and... -
23
Tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models
tiktoken is a high-performance, tokenizer library (based on byte-pair encoding, BPE) designed for use with OpenAI’s models. It handles encoding and decoding text to token IDs efficiently, with minimal overhead. Because tokenization is a fundamental step in preparing text for models, tiktoken is optimized for speed, memory, and correctness in model contexts (e.g. matching OpenAI’s internal tokenization). -
24
jsoniter-scala
Scala macros for compile-time generation of safe and ultra-fast JSON
Scala macros for compile-time generation of safe and ultra-fast JSON codecs. This library had started from macros that reused jsoniter (json-iterator) for Java reader and writer but then the library evolved to have its own core of mechanics for parsing and serialization. The idea to generate codecs by Scala macros and main details was borrowed from Kryo Macros and adapted for the needs of the JSON domain. Validate parsed values safely with the fail-fast approach and clear reporting, provide... -
25
Resty
Simple HTTP and REST client library for Go
Simple HTTP and REST client library for Go (inspired by Ruby rest-client). Features section describes in detail about Resty capabilities. Request URL Path Params (aka URI Params). Backoff Retry Mechanism with retry condition function reference. Resty client HTTP & REST Request and Response middleware. Request.SetContext supported. Authorization option of BasicAuth and Bearer token. Set request ContentLength value for all request or particular request. Custom Root Certificates and Client...
