Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case—while reducing latency and cost vs. conventional prompting or fine-tuning. It allows users to constrain generation (e.g. with regex and CFGs) as well as to interleave control (conditionals, loops, tool use) and generation seamlessly.

Features

  • Write pure Python, with additional LM functionality
  • Constrain generation with selects (i.e., sets of options), regular expressions, and context-free grammars, as well as with pre-built components
  • Documentation available
  • Examples available
  • Call and deploy tools easily with automatic interleaving of control and generation
  • Gain speed with stateful control + generation functions—no need for intermediate parsers

Project Samples

Guidance Screenshot 1

Project Activity

See All Activity >

Categories

Large Language Models (LLM)

License

MIT License

Follow Guidance

Guidance Web Site

Other Useful Business Software
$300 Free Credits to Build on Google Cloud Icon
$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Guidance!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Large Language Models (LLM)

Registered

2024-11-04
Report inappropriate content