Search Results for "processing"
Sort By:
Showing 79 open source projects for "processing"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Arroyo
Distributed stream processing engine in Rust
Arroyo is a distributed stream processing engine written in Rust, designed to efficiently perform stateful computations on streams of data. Unlike traditional batch processing, streaming engines can operate on both bounded and unbounded sources, emitting results as soon as they are available. -
2
Frame
Fast FFmpeg GUI
...Its modular design allows customization of workflows and integration into different environments. Overall, it serves as a practical utility for frame-level video processing and experimentation. -
3
Goose Swift
Goose Swift proof-of-concept README
...It is currently an alpha proof of concept intended for developers who can build the Swift app and Rust core themselves. The app connects to WHOOP 5.0 bands through Bluetooth and routes device data through a local Rust processing layer. It turns available signals into health, recovery, sleep, strain, stress, cardio, energy, coach, and debug views. The project includes a SwiftUI app, a Rust bridge, HealthKit support, a workout Live Activity extension, and internal documentation for its MVP pipeline. It is best understood as an experimental, independent wearable-data project rather than a finished consumer health tracker. -
4
Meetily
Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper
This project is a privacy-first AI meeting assistant that captures meeting audio, produces real-time transcripts, and generates summaries while keeping processing entirely on your own machine or infrastructure. It’s built for organizations that want meeting intelligence without sending recordings or transcripts to third-party cloud services, which helps address compliance and data sovereignty requirements. The app supports live transcription with local model options (including Whisper- and Parakeet-based workflows) and presents the transcript as the meeting happens, making it useful both for note-taking and accessibility. ... -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
5
Edgee
AI gateway with token compression for Claude Code, Codex, and more
Edgee is an edge-native execution platform designed to run AI-driven logic and data processing directly at the network edge, reducing latency and improving responsiveness for modern applications. It enables developers to deploy functions and workflows closer to users, allowing real-time processing without relying heavily on centralized cloud infrastructure. The platform is built to support event-driven architectures, where actions are triggered by incoming requests, user behavior, or external signals. ... -
6
jaq
A jq clone focussed on correctness, speed, and simplicity
jaq (pronounced like Jacques) is a clone of the JSON data processing tool jq. jaq aims to support a large subset of jq's syntax and operations. Jaq aims to provide a more correct and predictable implementation of jq, while preserving compatibility with jq in most cases. -
7
RuView
Turn WiFi signals into real-time human sensing and spatial awareness.
...Unlike traditional vision systems, RuView operates without cameras, wearables, or cloud connectivity, making it a privacy-first sensing solution. The system runs on low-cost hardware such as ESP32 sensor meshes and performs signal processing and machine learning directly at the edge. By learning the RF signature of each environment over time, RuView adapts automatically to different spaces and improves its sensing accuracy. Designed for applications ranging from healthcare monitoring to disaster response, it enables spaces to gain spatial awareness using the radio signals already present in the environment. -
8
Av1an
Cross-platform command-line AV1 / VP9 / HEVC / H264 encoding framework
Av1an is a command-line encoding framework designed to efficiently encode video into the AV1 format using distributed and parallel processing techniques. It acts as an orchestrator that splits video files into chunks, processes them in parallel using encoders like SVT-AV1, AOM, or rav1e, and then merges the results into a final output. The tool is optimized for high-quality encoding while reducing total processing time through multi-core and multi-machine support. It includes scene detection and chunking strategies to improve compression efficiency and visual consistency across segments. ... -
9
wx-cli
WeChat local data CLI with daemon architecture
...The tool can inspect conversations, chat history, unread messages, contacts, group members, group nicknames, favorites, statistics, exports, SNS feed items, public account articles, and image attachments. It is designed to be AI-agent friendly, with YAML output by default and optional JSON output for automation or downstream processing. The project keeps data local, decrypts in real time, and avoids full pre-decryption workflows. It is useful for users who need searchable, scriptable access to their own WeChat records while preserving local control over the data. -
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
10
Rsmpeg
A Rust crate that exposes FFmpeg's power as much as possible
Rsmpeg is a Rust-based binding for FFmpeg that provides low-level access to multimedia processing capabilities through safe and efficient abstractions. It allows developers to interact directly with FFmpeg libraries for tasks such as encoding, decoding, and stream manipulation. The library is designed to balance performance with safety by leveraging Rust’s ownership model and memory management features. It supports handling of containers, codecs, and frames, enabling fine-grained control over media workflows. rsmpeg is suitable for building high-performance multimedia applications that require precise control over processing pipelines. ... -
11
Coreutils for Windows
Coreutils for Windows: Installer & Packaging
Coreutils for Windows is a Microsoft-maintained package that brings UNIX-style command-line utilities to Windows natively. It gives Windows users familiar tools such as text processing, file handling, and pipeline commands without requiring Linux, macOS, or WSL. The project is designed for developers who want consistent shell behavior across platforms. It ships as a multi-call binary that exposes utilities under their standard command names. This makes it useful for scripting, automation, build workflows, and everyday command-line work on Windows. ... -
12
Arnis
Generate any location from the real world in Minecraft
...By converting geographic information into Minecraft blocks and structures, Arnis allows users to explore real cities, neighborhoods, and landscapes in a virtual environment that mirrors the real world. The tool handles large-scale geospatial processing and transforms raw mapping data into a format compatible with Minecraft world generation. Users can generate entire regions, including detailed urban layouts and natural terrain, making it useful for education, visualization, or creative world-building projects. -
13
CocoIndex
ETL framework to index data for AI, such as RAG
CocoIndex is an open-source framework designed for building powerful, local-first semantic search systems. It lets users index and retrieve content based on meaning rather than keywords, making it ideal for modern AI-based search applications. CocoIndex leverages vector embeddings and integrates with various models and frameworks, including OpenAI and Hugging Face, to provide high-quality semantic understanding. It’s built for transparency, ease of use, and local control over your search... -
14
Mako
An extremely fast, production-grade web bundler based on Rust
Mako is a new web bundler for web apps, libraries, and frameworks. It's designed to be fast, reliable, and easy to use. It has been used in hundreds of projects in production by Ant Group, and other companies. If you are looking for a modern web bundler, Mako is the right choice. -
15
dovi_tool
dovi_tool is a CLI tool combining multiple utilities
...It also supports demuxing and muxing HEVC streams, enabling manipulation of enhancement layers and metadata within video files. dovi_tool is widely used in advanced video encoding workflows where precise control over HDR metadata is required. Its modular design includes multiple subcommands that handle different aspects of processing, from inspection to transformation. Overall, it serves as a powerful utility for professionals working with Dolby Vision video pipelines. -
16
Lingua-RS
The most accurate natural language detection library for Rust
Lingua-RS is a language detection library implemented in Rust, designed to accurately identify the language of given text samples. It tells you which language some text is written in. This is very useful as a preprocessing step for linguistic data in natural language processing applications such as text classification and spell checking. Other use cases, for instance, might include routing e-mails to the right geographically located customer service department, based on the e-mails' languages. -
17
Sail
A drop-in Apache Spark replacement written in Rust
Sail is an open-source distributed computation framework designed to unify batch processing, stream processing, and AI workloads into a single, high-performance engine. It is built entirely in Rust, eliminating JVM overhead and enabling predictable performance, fast startup times, and improved memory safety compared to traditional big data frameworks. Sail is compatible with the Spark Connect protocol, which means existing Spark SQL and DataFrame workloads can run without code changes, making adoption seamless for teams already using Spark-based pipelines. ... -
18
IronCalc
Main engine of the IronCalc ecosystem
IronCalc is a new, modern, work-in-progress spreadsheet engine and set of tools to work with spreadsheets in diverse settings. IronCalc is a lightweight, open-source computational engine designed for performing mathematical operations, formula calculations, and data-driven tasks. -
19
SemTools
Semantic search and document parsing tools for the command line
...The project focuses on enabling developers and AI agents to process large document collections and extract meaningful semantic representations that can be searched efficiently. Built with Rust for performance and reliability, the toolchain provides fast processing of text and structured documents while maintaining low system overhead. SemTools can parse documents, build semantic embeddings, and perform similarity searches across datasets, making it useful for research, knowledge management, and AI-assisted coding workflows. The toolkit is designed to work well with modern AI pipelines, particularly those involving large language models that require structured knowledge retrieval. -
20
QSV
Blazing-fast Data-Wrangling toolkit
qsv is a fast, command-line CSV data toolkit written in Rust that extends the capabilities of xsv. It’s designed to make working with CSV files at scale easy and efficient, offering over 40 powerful subcommands for tasks like querying, sampling, splitting, deduplicating, and more. qsv is ideal for data engineers, analysts, and developers who need high-performance CSV manipulation on the command line. -
21
conflux-rust
The official Rust implementation of Conflux protocol
conflux-rust is the Rust implementation of Conflux, a high-performance Layer 1 blockchain designed to deliver high throughput without compromising decentralization or security. Conflux introduces a Tree-Graph consensus mechanism that allows parallel block processing while maintaining consensus integrity. This implementation focuses on performance and is compatible with the Ethereum Virtual Machine (EVM), enabling developers to deploy smart contracts written for Ethereum. It provides a robust foundation for dApps, DeFi, and Web3 applications in regions requiring regulatory compliance and scalability. -
22
Scanopy
Clean network diagrams, One-time setup, zero upkeep
Scanopy is a powerful multi-modal data capture and analysis toolkit that enables users to collect, process, and visualize structured and unstructured information from a variety of sources in a flexible pipeline. It is built to handle complex scanning tasks — such as OCR, document analysis, audio transcription, network data capture, and image extraction — while providing unified APIs and workflows that make managing heterogeneous data sources seamless. Developers can compose custom pipelines... -
23
Vector
A high-performance observability data pipeline
Vector is a Rust‑based, high‑performance observability data pipeline tool (agent + aggregator) designed to collect, transform, and route logs and metrics at scale. Created by Datadog, it aims to be the only tool needed from ingestion to vendor output, providing cost-efficient, safe, and flexible telemetry processing. -
24
FFmpeg Sidecar
Wrap a standalone FFmpeg binary in an intuitive Iterator interface
FFmpeg Sidecar is a Rust library that wraps a standalone FFmpeg binary and exposes it through an intuitive, iterator-based interface. It allows developers to interact with video streams as sequences of raw frames, abstracting the complexity of decoding and processing media. The library leverages FFmpeg’s CLI instead of low-level bindings, simplifying setup and avoiding heavy dependencies. It enables streaming data through stdin and stdout, making it suitable for real-time processing pipelines. Additionally, it parses FFmpeg logs to extract structured information such as progress, metadata, and errors. ... -
25
RuVector
Self-Learning, Vector Graph Neural Network, and Database built in Rust
RuVector is part of the broader rUv ecosystem of AI engineering tools and focuses on enabling advanced vector-based processing and intelligent system development within agentic and AI-driven pipelines. The project fits into a larger vision of modular, composable AI infrastructure designed to support autonomous agents, data retrieval, and intelligent automation workflows. It emphasizes extensibility and interoperability with modern AI stacks, allowing developers to integrate vector operations into search, reasoning, or generative systems. ...
