Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case—while reducing latency and cost vs. conventional prompting or fine-tuning. It allows users to constrain generation (e.g. with regex and CFGs) as well as to interleave control (conditionals, loops, tool use) and generation seamlessly.

Features

  • Write pure Python, with additional LM functionality
  • Constrain generation with selects (i.e., sets of options), regular expressions, and context-free grammars, as well as with pre-built components
  • Documentation available
  • Examples available
  • Call and deploy tools easily with automatic interleaving of control and generation
  • Gain speed with stateful control + generation functions—no need for intermediate parsers

Project Samples

Guidance Screenshot 1

Project Activity

See All Activity >

Categories

Large Language Models (LLM)

License

MIT License

Follow Guidance

Guidance Web Site

Other Useful Business Software
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
Try Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Guidance!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Large Language Models (LLM)

Registered

2024-11-04
Report inappropriate content