Showing 5098 open source projects for "processing"

View related business solutions
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Start Free
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Start Free
  • 1
    GH Archive

    GH Archive

    GH Archive is a project to record the public GitHub timeline

    GH Archive collects public GitHub activity and preserves it as a historical dataset for analysis. It polls GitHub’s event feed and groups the raw responses into compressed hourly JSON archives. The records cover actions such as commits, forks, issue activity, comments, and repository membership changes. Researchers can download specific hours, days, or longer periods with ordinary HTTP tools and process the events in their own systems. The dataset is also published through Google BigQuery...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    JetLinks

    JetLinks

    JetLinks is developed based on Java, Spring Boot, WebFlux, Netty

    ...It can connect devices through TCP, UDP, MQTT, HTTP, TLS, DTLS, and other protocol patterns while hiding much of the complexity of network programming. JetLinks also includes real-time data processing, device alerts, message notifications, data forwarding, geographic features, visualization, and a configurable rule engine. It is best suited for companies that need a customizable IoT foundation for device management, telemetry, automation, and industrial or enterprise monitoring.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    Superstreamer

    Superstreamer

    An open, scalable, online streaming setup

    Superstreamer is a self-hosted video processing and delivery platform designed to simplify the entire workflow from media ingestion to adaptive playback. It provides developers with tools to transcode video files into multiple quality levels and package them into streaming-ready formats such as HLS playlists. The system enables dynamic playlist generation, allowing insertion of elements like ads or bumpers directly into video streams.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    hash-wasm

    hash-wasm

    Lightning fast hash functions using hand-tuned WebAssembly binaries

    ...The library supports a wide range of algorithms, including MD5, SHA variants, BLAKE, Argon2, bcrypt, and xxHash, making it suitable for applications ranging from security to data processing. By compiling optimized C implementations into WebAssembly, hash-wasm achieves significantly better performance compared to pure JavaScript alternatives while maintaining portability across platforms. It supports both simple one-shot hashing and advanced streaming modes, allowing developers to process large datasets incrementally. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Veeam Data Platform v13.1 - Get Your Free Trial Icon
    Veeam Data Platform v13.1 - Get Your Free Trial

    Secure by design, portable by default. Recover clean, fast, anywhere. Start a free trial.

    Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
    Try it Free
  • 5
    Google Highway

    Google Highway

    Performance-portable, length-agnostic SIMD with runtime dispatch

    ...This portability is achieved through dynamic or static dispatch mechanisms that select the best available instruction set at runtime or compile time. The library is designed for developers who need to maximize CPU performance in domains such as image processing, compression, cryptography, and scientific computing.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Desloppify

    Desloppify

    Agent harness to make your slop code well-engineered and beautiful

    ...This makes it especially useful in workflows where AI-generated text needs to be refined before publication or use in production. It may also support integration into pipelines, allowing automatic post-processing of outputs. The project reflects a growing need to manage and optimize AI-generated content rather than simply produce it. Overall, desloppify acts as a refinement layer that enhances clarity and usability of textual outputs.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    clip-retrieval

    clip-retrieval

    Easily compute clip embeddings and build a clip retrieval system

    ...It allows developers to compute embeddings for both images and text efficiently and then index them for fast similarity search across massive datasets. The system is optimized for performance and scalability, capable of processing tens or even hundreds of millions of embeddings using GPU acceleration. It includes components for inference, indexing, filtering, and serving results through APIs, making it a complete pipeline for building production-ready retrieval systems. The framework also supports querying by image, text, or embedding, enabling flexible use cases such as reverse image search or multimodal content discovery. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    LitServe

    LitServe

    Minimal Python framework for scalable AI inference servers fast

    ...Unlike traditional serving tools that enforce rigid abstractions, LitServe focuses on flexibility by letting users control request handling, batching strategies, and output processing directly in Python. LitServe is built on top of FastAPI and extends it with AI-specific optimizations such as efficient multi-worker execution, which can significantly improve throughput. It includes built-in capabilities for batching, streaming responses, and automatic scaling across CPUs and GPUs, enabling high-performance deployments.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Gooo

    Gooo

    Toolkit for developing web applications in Vue, Templ, and Go

    Gooo is an open-source project that focuses on providing tools and utilities for interacting with and analyzing online content, particularly in the context of automation and data retrieval workflows. The repository appears to function as a lightweight utility toolkit that can be adapted for specific use cases such as scraping, automation, or content processing. It is structured to allow developers to customize and extend its functionality depending on their needs, rather than acting as a fully packaged end-user application. The project emphasizes simplicity and flexibility, enabling users to integrate its components into scripts or larger systems. While not as feature-heavy as enterprise frameworks, it serves as a foundation for experimentation and rapid prototyping in data extraction or automation tasks. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Fully Managed MySQL, PostgreSQL, and SQL Server Icon
    Fully Managed MySQL, PostgreSQL, and SQL Server

    Automatic backups, patching, replication, and failover. Focus on your app, not your database.

    Cloud SQL handles your database ops end to end, so you can focus on your app.
    Start Free
  • 10
    SemTools

    SemTools

    Semantic search and document parsing tools for the command line

    ...The project focuses on enabling developers and AI agents to process large document collections and extract meaningful semantic representations that can be searched efficiently. Built with Rust for performance and reliability, the toolchain provides fast processing of text and structured documents while maintaining low system overhead. SemTools can parse documents, build semantic embeddings, and perform similarity searches across datasets, making it useful for research, knowledge management, and AI-assisted coding workflows. The toolkit is designed to work well with modern AI pipelines, particularly those involving large language models that require structured knowledge retrieval.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    docext

    docext

    An on-premises, OCR-free unstructured data extraction

    ...The system is designed to operate entirely on-premises, allowing organizations to process sensitive documents without relying on external cloud services. Unlike traditional document processing pipelines that rely heavily on optical character recognition, docext leverages multimodal AI models capable of understanding both visual and textual information directly from document images. This allows the system to detect and extract structured elements such as tables, signatures, key fields, and layout information while maintaining semantic understanding of the document content. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    pyAudioAnalysis

    pyAudioAnalysis

    Python Audio Analysis Library: Feature Extraction, Classification

    ...Because the library integrates machine learning algorithms with signal processing tools, it enables researchers to develop complete audio analysis pipelines using a single framework.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    MetaScreener

    MetaScreener

    AI-powered tool for efficient abstract and PDF screening

    ...The platform can analyze both abstracts and full PDF documents, enabling automated filtering based on research criteria defined by the user. By incorporating natural language processing techniques, the system can identify potentially relevant studies and reduce the workload associated with manual screening.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    MoBA

    MoBA

    MoBA: Mixture of Block Attention for Long-Context LLMs

    MoBA, short for Mixture of Block Attention, is an open-source research implementation of a novel attention mechanism designed to improve the efficiency of large language models processing extremely long contexts. The architecture adapts ideas from Mixture-of-Experts networks and applies them directly to the attention mechanism of transformer models. Instead of forcing each token to attend to every other token in the sequence, MoBA divides the context into blocks and dynamically routes queries to only the most relevant segments of information. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    WeClone

    WeClone

    One-stop solution for creating your digital avatar from chat history

    ...The system analyzes message patterns, linguistic style, and contextual behavior in order to generate responses that resemble the original user’s communication style. It is intended primarily as an experimental exploration of digital personality modeling and conversational AI personalization. By processing large volumes of conversation data, WeClone can build a profile of an individual’s writing tone, vocabulary preferences, and conversational tendencies. Developers can use the resulting model to create chatbots that simulate a specific user’s communication patterns for testing or research purposes. Overall, WeClone explores the idea of digital identity replication through machine learning and conversational modeling.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Scanopy

    Scanopy

    Clean network diagrams, One-time setup, zero upkeep

    Scanopy is a powerful multi-modal data capture and analysis toolkit that enables users to collect, process, and visualize structured and unstructured information from a variety of sources in a flexible pipeline. It is built to handle complex scanning tasks — such as OCR, document analysis, audio transcription, network data capture, and image extraction — while providing unified APIs and workflows that make managing heterogeneous data sources seamless. Developers can compose custom pipelines...
    Downloads: 10 This Week
    Last Update:
    See Project
  • 17
    Deep Research

    Deep Research

    Use any LLMs (Large Language Models) for Deep Research

    ...It combines “thinking” and “task” model roles with live internet access to plan, search, read, and synthesize findings into structured outputs. The project emphasizes privacy: processing and storage happen locally, avoiding server-side retention of your queries and notes. A simple web UI lets you enter topics and configure models, while the backend streams progress as sources are fetched and arguments are weighed. It offers MCP server support and SSE APIs, so IDEs and agent clients can drive the same workflow programmatically. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    GenStage

    GenStage

    Producer and consumer actors with back-pressure for Elixir

    ...Its clear separation of concerns encourages testable, composable stages that can be rearranged as requirements evolve. In production, this leads to predictable, resilient dataflows for event ingestion, batching, and parallel processing.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    CocoIndex

    CocoIndex

    ETL framework to index data for AI, such as RAG

    CocoIndex is an open-source framework designed for building powerful, local-first semantic search systems. It lets users index and retrieve content based on meaning rather than keywords, making it ideal for modern AI-based search applications. CocoIndex leverages vector embeddings and integrates with various models and frameworks, including OpenAI and Hugging Face, to provide high-quality semantic understanding. It’s built for transparency, ease of use, and local control over your search...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    ClimateTools.jl

    ClimateTools.jl

    Climate science package for Julia

    Climate analysis tools in Julia. ClimateTools.jl is a collection of commonly-used tools in Climate science. Basics of climate field analysis are covered, with some forays into exploratory techniques associated with climate scenario design. The package is aimed to ease the typical steps of analysis of climate models outputs and gridded datasets (support for weather stations is a work-in-progress). Climate indices and bias correction functions are coded to leverage the use of multiple threads....
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    dperf

    dperf

    DPDK based 100Gbps network performance and load testing software

    ...Load testing and stability testing for Layer 4 Load Balancer and other Layer 4 gateways. Network performance testing for servers on cloud. Performance test of network package processing capability for NIC and CPU. Can be used as a high-performance HTTP server or client for load testing.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Asynq

    Asynq

    Simple, reliable, and efficient distributed task queue in Go

    Asynq is a Go library for queueing tasks and processing them asynchronously with workers. It's backed by Redis and is designed to be scalable yet easy to get started. Client puts tasks on a queue. Server pulls tasks off queues and starts a worker goroutine for each task. Tasks are processed concurrently by multiple workers. Task queues are used as a mechanism to distribute work across multiple machines.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    loonflow

    loonflow

    A workflow engine base on django python

    ...Scenario services), if there is a certain development capability, it is recommended to use only the back-end engine function, and the front-end customized development according to the scenario can be dispersed in various internal background management systems (such as personnel, operation and maintenance, monitoring, cmdb, etc.). Since version 1.1.x, loonflow comes with a front-end interface for creating and processing work orders, which can be used directly. The official version is shown in the release . It is recommended to use the latest version.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    SwarmUI

    SwarmUI

    Modular AI image and video generation web UI with extensible tools

    SwarmUI is a modular web-based user interface designed for AI-driven image generation, with a strong focus on usability, performance, and extensibility. It serves as a unified environment for working with multiple AI models, including Stable Diffusion and newer image and video generation systems, allowing users to create and manage outputs through a browser interface. SwarmUI is built to accommodate both beginners and advanced users by offering a simple “Generate” interface alongside more...
    Downloads: 13 This Week
    Last Update:
    See Project
  • 25
    sticker-convert

    sticker-convert

    Convert (animated) stickers to/from WhatsApp, Telegram, Signal

    sticker-convert is a utility tool designed to convert sticker packs between formats used by messaging platforms such as WhatsApp and Telegram. It simplifies the process of adapting sticker files, including image formats, animations, and metadata. The tool supports batch conversion, making it efficient for handling entire sticker collections. It is particularly useful for users and developers who want to migrate or reuse sticker assets across platforms. The project automates resizing, format...
    Downloads: 6 This Week
    Last Update:
    See Project