Laya is an open-source, non-autoregressive decision engine designed to answer structured questions without generating free-form text. It supports choice, score, and yes-or-no probability decisions in a single forward pass. The system works across more than 100 languages and uses a router to select an appropriate checkpoint for each request. It can run locally on CPU or GPU hardware and includes Python and TypeScript tooling. Integrations are available for HTTP, MCP, LangChain, LangGraph, LlamaIndex, CrewAI, and ONNX workflows. Laya is intended for fast classification, routing, triage, scoring, and other structured decisions where predictable outputs are more useful than generated prose.

Features

  • Choice, score, and yes-or-no decisions
  • Support for more than 100 languages
  • Single-pass non-autoregressive inference
  • Automatic checkpoint routing
  • Python and TypeScript APIs
  • HTTP, MCP, LangChain, and LlamaIndex integrations

Project Samples

Project Activity

See All Activity >

Categories

System

License

Apache License V2.0

Follow Laya

Laya Web Site

Other Useful Business Software
$300 Free Credits to Build on Google Cloud Icon
$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Laya!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python System Software

Registered

13 hours ago