Download
Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case—while reducing latency and cost vs. conventional prompting or fine-tuning. It allows users to constrain generation (e.g. with regex and CFGs) as well as to interleave control (conditionals, loops, tool use) and generation seamlessly.
Features
- Write pure Python, with additional LM functionality
- Constrain generation with selects (i.e., sets of options), regular expressions, and context-free grammars, as well as with pre-built components
- Documentation available
- Examples available
- Call and deploy tools easily with automatic interleaving of control and generation
- Gain speed with stateful control + generation functions—no need for intermediate parsers
Project Samples
Categories
Large Language Models (LLM)License
MIT LicenseFollow Guidance
Other Useful Business Software
AI-generated apps that pass security review
Retool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Guidance!
