Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case—while reducing latency and cost vs. conventional prompting or fine-tuning. It allows users to constrain generation (e.g. with regex and CFGs) as well as to interleave control (conditionals, loops, tool use) and generation seamlessly.

Features

  • Write pure Python, with additional LM functionality
  • Constrain generation with selects (i.e., sets of options), regular expressions, and context-free grammars, as well as with pre-built components
  • Documentation available
  • Examples available
  • Call and deploy tools easily with automatic interleaving of control and generation
  • Gain speed with stateful control + generation functions—no need for intermediate parsers

Project Samples

Guidance Screenshot 1

Project Activity

See All Activity >

Categories

Large Language Models (LLM)

License

MIT License

Follow Guidance

Guidance Web Site

Other Useful Business Software
$300 in Free Credit Towards Top Cloud Services Icon
$300 in Free Credit Towards Top Cloud Services

Build VMs, containers, AI, databases, storage—all in one place.

Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
Get Started
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Guidance!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Large Language Models (LLM)

Registered

2024-11-04
Report inappropriate content