Search Results for "probability"

...Supported question formats include yes-or-no, multiple choice, and ordered scoring. Checkpoints range from a compact 0.8B model for smaller hardware to a 27B version for high-end systems. The models include probability calibration and can run through CUDA, ROCm, or MLX depending on hardware. Kev exposes an API compatible with TypeSafe System One, allowing compatible clients to target a locally hosted server. Developers can also fine-tune models on their own labeled examples and deploy private HTTPS endpoints.

Laya-MLX is an independent MLX implementation of Laya’s typed decision models for Apple Silicon Macs. It performs structured choice, score, and probability decisions without token-by-token text generation. Inference runs fully locally after model weights are downloaded and does not require PyTorch, Transformers, or a cloud API. The runtime supports English, multilingual, and typed-decision Laya checkpoints while preserving their original calibration and output formats. Its implementation moves the encoder, decision transformer, scoring head, and action head into MLX. ...

SemIf, formerly OpenJev, is an independent research project for making small semantic decisions with open language models. Instead of generating text and parsing it afterward, it reads probabilities directly from declared answer options. Each request supplies state, a runtime-defined question, and typed choices, allowing the model to behave like a semantic conditional. Shared-state execution can reuse a long context across many related decisions to reduce repeated computation. Backends...

Laya is an open-source, non-autoregressive decision engine designed to answer structured questions without generating free-form text. It supports choice, score, and yes-or-no probability decisions in a single forward pass. The system works across more than 100 languages and uses a router to select an appropriate checkpoint for each request. It can run locally on CPU or GPU hardware and includes Python and TypeScript tooling. Integrations are available for HTTP, MCP, LangChain, LangGraph, LlamaIndex, CrewAI, and ONNX workflows. ...