Search Results for "inference"
Sort By:
Showing 18 open source projects for "inference"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
1
whisper.cpp
Port of OpenAI's Whisper model in C/C++
...The entire high-level implementation of the model is contained in whisper.h and whisper.cpp. The rest of the code is part of the ggml machine learning library. The command downloads the base.en model converted to custom ggml format and runs the inference on all .wav samples in the folder samples. whisper.cpp supports integer quantization of the Whisper ggml models. Quantized models require less memory and disk space and depending on the hardware can be processed more efficiently. -
2
WiFi DensePose
Turn WiFi signals into real-time human pose estimation and detection
...It is designed to showcase the emerging field of RF-based sensing, where machine learning models interpret wireless channel data to reconstruct human movement and posture. The repository includes components for data processing, model inference, and real-time visualization, making it suitable for research and experimental deployments. Its architecture emphasizes performance and reproducibility, allowing developers to explore non-visual motion capture systems using accessible hardware. Overall, WiFi DensePose functions as an advanced research-grade toolkit for WiFi-based human sensing and pose estimation. -
3
Arize Phoenix
Uncover insights, surface problems, monitor, and fine tune your LLM
Phoenix provides ML insights at lightning speed with zero-config observability for model drift, performance, and data quality. Phoenix is an Open Source ML Observability library designed for the Notebook. The toolset is designed to ingest model inference data for LLMs, CV, NLP and tabular datasets. It allows Data Scientists to quickly visualize their model data, monitor performance, track down issues & insights, and easily export to improve. Deep Learning Models (CV, LLM, and Generative) are an amazing technology that will power many of future ML use cases. A large set of these technologies are being deployed into businesses (the real world) in what we consider a production setting. -
4
Laya
Non-autoregressive System 1 decision engine
Laya is an open-source, non-autoregressive decision engine designed to answer structured questions without generating free-form text. It supports choice, score, and yes-or-no probability decisions in a single forward pass. The system works across more than 100 languages and uses a router to select an appropriate checkpoint for each request. It can run locally on CPU or GPU hardware and includes Python and TypeScript tooling. Integrations are available for HTTP, MCP, LangChain, LangGraph,... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
FlashKDA
High-performance Kimi Delta Attention kernels
...It is intended to accelerate the forward pass used by KDA-based language models on modern NVIDIA GPUs. The package integrates with flash-linear-attention and can be selected automatically as the backend for chunk_kda during inference. It supports recurrent state input and output, variable-length batches, internal gating, query-key normalization, and beta activation. Builds can target the detected GPU architecture or multiple supported architectures for wheels and CI pipelines. The repository also provides correctness tests, benchmark material, a direct Python kernel API, and development helpers for CUDA and C++ tooling. -
6
MiniSearch
Minimalist web-searching platform with an AI assistant
MiniSearch is a minimalist web search application with a built-in AI assistant that runs largely inside the browser for privacy-focused information retrieval. The project combines metasearch capabilities with local or remote language model inference to provide conversational answers alongside traditional search results. It is designed to be lightweight, easy to deploy with Docker, and configurable for both personal and hosted use cases. The platform supports browser-level integration so users can set it as their default search engine for quick access. Its architecture emphasizes privacy by avoiding tracking and minimizing data collection while still enabling advanced AI features. ... -
7
Genv
GPU environment management and cluster orchestration
Genv is an open-source environment and cluster management system for GPUs. Genv lets you easily control, configure, monitor and enforce the GPU resources that you are using in a GPU machine or cluster. It is intended to ease up the process of GPU allocation for data scientists without code changes. -
8
OnnxStream
Lightweight inference library for ONNX files, written in C++
The challenge is to run Stable Diffusion 1.5, which includes a large transformer model with almost 1 billion parameters, on a Raspberry Pi Zero 2, which is a microcomputer with 512MB of RAM, without adding more swap space and without offloading intermediate results on disk. The recommended minimum RAM/VRAM for Stable Diffusion 1.5 is typically 8GB. Generally, major machine learning frameworks and libraries are focused on minimizing inference latency and/or maximizing throughput, all of which at the cost of RAM usage. So I decided to write a super small and hackable inference library specifically focused on minimizing memory consumption: OnnxStream. OnnxStream is based on the idea of decoupling the inference engine from the component responsible for providing the model weights, which is a class derived from WeightsProvider. ... -
9
DeepSpeech
Open source embedded speech-to-text engine
...A pre-trained English model is available for use and can be downloaded following the instructions in the usage docs. If you want to use the pre-trained English model for performing speech-to-text, you can download it (along with other important inference material) from the DeepSpeech releases page. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
filetype
Fast, dependency-free Go package to infer binary file types
filetype is a fast, dependency-free Go package for identifying binary file formats from their magic-number signatures. It examines file headers rather than relying on filename extensions, making detection useful for uploads and untrusted input. The API can match raw byte buffers and return a detected extension and MIME type. Developers can also check whether data belongs to supported categories such as images, audio, video, archives, or documents. Custom file-type matchers can be registered... -
11
Albedo
A recommender system for discovering GitHub repos
Albedo is an open-source recommender system aimed at helping developers discover GitHub repositories by learning from activity signals. It treats repositories and developers as a graph of interactions and applies large-scale matrix factorization to model affinities, with Apache Spark providing the distributed data processing. The project focuses on implicit feedback—stars, watches, and other engagement metrics—so it can build useful recommendations without explicit ratings. A reproducible... -
12
core.typed
An optional type system for Clojure
core.typed is an optional static type system for Clojure, providing gradual typing features like type declarations, checking, and inference. It supports modules for development-time checking and runtime typing, though note that it's deprecated as of Clojure 1.11 in favor of Typed Clojure. core.typed is separated into modules. You'll want the full type checker at development time, and the runtime dependencies in production. Then, lein repl will automatically activate the :dev profile. ... -
13
SemWebTech_eval
Evaluation Presentation for Semantic Web Technologies
This is the Project Page for Evaluation Jena. It contains several Scripts to test the Inference Engine, and perform Benchmark tests. -
14
Experts System (CLIPS) - PC Guide
An Expert System developed in CLIPS on how to Build a PC
...This part of the system would ask a question to the user and, according to the answer, respond with the next question or answer. This is done by using a inference engine that I designed along with the knowledge base and search tree to interrupt and use the input provided as an answer to the question. -
15
Mandarax is a pure Java implementation of a rule engine. It supports mutiples types of facts and rules based on reflection, databases, EJB etc, supporting XML standards (RuleML 0.8). It provides a J2EE compliant inference engine using backward chaining.
-
16
Self-aware dynamic, reflective, and declarative semantic space representation, transformation, and exploration system.
-
17
SIES is a forward-chaining rule engine server. Clients connect to update a global knowledge-base and/or can register to be notified when specified elements are inferred. Local access for a client's own inferences is also possible.
-
18
The Prolog Expert System Shell (PESS) is a software that generates ES using basically two components: Knowledge Base, used by the ES to guide its decisions making, and Inference Machine, cable of collection the rules and generating new facts.
- Previous
- You're on page 1
- Next
