Search Results for "index data"
Sort By:
Showing 12 open source projects for "index data"
View related business solutions-
Compliant and Reliable File Transfers Backed by Top Security CertificationsStop relying on non-certified, legacy file transfer tools that creak under the weight of modern security demands. Get full audit trails, advanced access controls and more supported by an award-winning team of experts. Start your free 25-day trial today.
-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
1
CocoIndex
ETL framework to index data for AI, such as RAG
CocoIndex is an open-source framework designed for building powerful, local-first semantic search systems. It lets users index and retrieve content based on meaning rather than keywords, making it ideal for modern AI-based search applications. CocoIndex leverages vector embeddings and integrates with various models and frameworks, including OpenAI and Hugging Face, to provide high-quality semantic understanding. It’s built for transparency, ease of use, and local control over your search data, distinguishing itself from closed, black-box systems. ... -
2
RedisJSON
RedisJSON - a JSON data type for Redis
RedisJSON is a Redis module that implements ECMA-404 The JSON Data Interchange Standard as a native data type. It allows storing, updating and fetching JSON values from Redis keys (documents). -
3
jql
A JSON Query Language CLI tool
jql is a JSON Query Language tool built with Rust. -
4
parseable
Parseable is a log analytics system written in Rust
Parseable is a log analytics platform, built for the modern, cloud native era. Parseable uses a index-free mechanism to organize and query data allowing low latency, and high throughput ingestion and query. -
Forever Free Full-Stack Observability | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
5
tinysearch
Tiny, full-text search engine for static websites built with Rust
tinysearch is a lightweight full-text search engine designed specifically for static websites, offering fast and efficient search capabilities without requiring a backend server. It is written in Rust and compiled to WebAssembly, allowing it to run entirely in the browser while maintaining a very small footprint. The engine uses compact data structures such as XOR filters to efficiently index and query text, significantly reducing memory usage compared to traditional search libraries. TinySearch is particularly well-suited for blogs and documentation sites generated by static site generators, where simplicity and performance are critical. It processes content into a serialized binary index that can be loaded quickly and searched client-side, eliminating the need for external search services. ... -
6
Spider
High-performance Rust web crawler and scraper for large-scale data
...Spider also provides mechanisms for subscribing to crawl events so developers can process page data such as URLs, status codes, or HTML content as it is discovered. It supports advanced capabilities such as headless browser rendering, background crawling tasks, and configurable rules that control crawl depth or ignored paths. These capabilities make the project suitable for building search indexers, data extraction pipelines, & SEO analysis tools. -
7
Discord.SortedSet
Elixir SortedSet backed by a Rust-based NIF
SortedSet NIF is a performant and reliable sorted set data structure for Elixir, implemented in Rust using the Rustler crate to take advantage of native performance while maintaining seamless integration with the BEAM ecosystem. It provides ordering and uniqueness guarantees, with all terms stored according to Elixir’s built-in sorting rules. Internally, it uses a vector of vectors layout rather than a single vector to minimize costly reallocations, allowing efficient bucket pointer copying... -
8
Quickwit
Sub-second search & analytics engine on cloud storage
...However, we only support ES aggregation DSL, the query DSL support is planned for Q2 2023. The core difference and advantage of Quickwit are its architecture built from the ground to search on cloud storage. We optimized IO paths, revamped the index data structures and made search stateless and sub-second on cloud storage. Quickwit is open-source under the GNU Affero General Public License Version 3 - AGPLv3. Fundamentally, this means you are free to use Quickwit for your project if you don't modify Quickwit. However, if you do and you are distributing your modified version to the public, you have to make the modifications public. -
9
Voy
A WASM vector similarity search written in Rust
Voy is a lightweight WebAssembly-based vector similarity search engine written in Rust that enables semantic search capabilities directly in browser or edge environments. It is designed to operate on embeddings generated from text or other data, allowing applications to perform meaning-based search rather than simple keyword matching. The engine uses efficient data structures such as k-d trees to index vectors and perform fast nearest-neighbor queries, making it suitable for real-time search experiences. One of its key advantages is its extremely small footprint, allowing it to be deployed easily on CDNs or client-side applications without significant overhead. ... -
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
10
sled
The champagne of beta embedded databases
...Uses modern b-tree techniques such as prefix encoding and suffix truncation for reducing the storage costs of long keys with shared prefixes. If keys are the same length and sequential then the system can avoid storing 99%+ of the key data in most cases, essentially acting like a learned index. sled performs prefix encoding on long keys with similar prefixes that are grouped together in a range, as well as suffix truncation to further reduce the indexing costs of long keys. -
11
xsv
A fast CSV command line toolkit written in Rust
xsv is a command line program for indexing, slicing, analyzing, splitting and joining CSV files. Commands should be simple, fast and composable. Simple tasks should be easy. Performance trade offs should be exposed in the CLI interface. Composition should not come at the expense of performance. Let's say you're playing with some of the data from the Data Science Toolkit, which contains several CSV files. Maybe you're interested in the population counts of each city in the world. So grab the... -
12
Pikkr
JSON parser to pick up values directly without performing tokenization
JSON Parser which picks up values directly without performing tokenization in Rust. Pikkr is a JSON parser that picks up values directly without performing tokenization in Rust. Creates an index which maps logical locations of queried fields to their physical locations by using SIMD instructions and bit manipulation. Finds values of queried fields by scanning a JSON record using the index created in the previous process and learns their logical locations (i.e. pattern of the JSON structure)...
- Previous
- You're on page 1
- Next
