Download
Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case—while reducing latency and cost vs. conventional prompting or fine-tuning. It allows users to constrain generation (e.g. with regex and CFGs) as well as to interleave control (conditionals, loops, tool use) and generation seamlessly.
Features
- Write pure Python, with additional LM functionality
- Constrain generation with selects (i.e., sets of options), regular expressions, and context-free grammars, as well as with pre-built components
- Documentation available
- Examples available
- Call and deploy tools easily with automatic interleaving of control and generation
- Gain speed with stateful control + generation functions—no need for intermediate parsers
Project Samples
Categories
Large Language Models (LLM)License
MIT LicenseFollow Guidance
Other Useful Business Software
Ship Agents Faster
Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Guidance!