Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case—while reducing latency and cost vs. conventional prompting or fine-tuning. It allows users to constrain generation (e.g. with regex and CFGs) as well as to interleave control (conditionals, loops, tool use) and generation seamlessly.

Features

  • Write pure Python, with additional LM functionality
  • Constrain generation with selects (i.e., sets of options), regular expressions, and context-free grammars, as well as with pre-built components
  • Documentation available
  • Examples available
  • Call and deploy tools easily with automatic interleaving of control and generation
  • Gain speed with stateful control + generation functions—no need for intermediate parsers

Project Samples

Guidance Screenshot 1

Project Activity

See All Activity >

Categories

Large Language Models (LLM)

License

MIT License

Follow Guidance

Guidance Web Site

Other Useful Business Software
Go From AI Idea to AI App Fast Icon
Go From AI Idea to AI App Fast

One platform to build, fine-tune, and deploy ML models. No MLOps team required.

Access Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
Try Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Guidance!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Large Language Models (LLM)

Registered

2024-11-04
Report inappropriate content