promptfoo Files

Evaluate and compare LLM outputs, catch regressions, improve prompts

This is an exact mirror of the promptfoo project, hosted at https://github.com/promptfoo/promptfoo. SourceForge is not affiliated with promptfoo.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
0.121.20 source code.tar.gz	2026-07-31	181.8 MB	0
0.121.20 source code.zip	2026-07-31	184.7 MB	3
README.md	2026-07-31	5.1 kB	0
Totals: 3 Items		366.5 MB	3

0.121.20 (2026-07-30)

Features

providers: add Claude Opus 5 support (#10210) (ff84f13)
providers: add current Azure, Claude, and Gemini models (#10128) (5c216a1)
providers: add Kimi K3 support to Moonshot provider (#10132) (a1168b6)
websocket: support URL templating (#10171) (a9aaced)

Bug Fixes

assertions: default conversation-relevance threshold to 0.5 (#10142) (2812d76)
azure: avoid crash on empty completion choices (#10124) (17d8d03)
deps: align Renovate npm registry (#10115) (688a905)
deps: update anthropic packages (#10146) (cfa9bee)
deps: update anthropic packages (#10199) (2d3f3f1)
deps: update anthropic packages (#10229) (2834215)
deps: update dependency js-yaml to v5.2.2 [security] (#10218) (18ea879)
eval: avoid prompt index collisions for duplicate providers (#10208) (5aa0958)
eval: isolate conversation history by result column (#10212) (a377bb7)
integrations: migrate Langfuse prompts to SDK v5 (#10131) (08b3f50)
providers: align OpenAI models and capabilities (#10125) (e17ce87)
providers: preserve WebSocket retries for certificate-like URLs (#10197) (85e0710)
providers: reject Vertex Omni passthrough follow-ups (#10135) (8482570)
providers: restore secret-safe WebSocket retries (#10176) (6d89cbb)
python: keep worker control markers on their own line (#10097) (6bc2b95)
redteam: harden risk reports and WebSocket timeout tests (#10211) (9ab178e)
redteam: improve risk-category report row accessibility (b163738)
redteam: preserve generation provider selection (#10133) (ac8971f)
site: repair stale event pages, dead links, and hydration mismatches (#10215) (b0e3c25)

Source: README.md, updated 2026-07-31

Other Useful Business Software

MongoDB Atlas runs apps anywhere Icon

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

$300 Free Credits for Your Google Cloud Projects Icon

$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.

Start Free Trial

$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.

Start Free Trial

Recommended Projects

DeepEval
DeepEval is a simple-to-use, open-source LLM evaluation framework, for evaluating and testing large-language model systems. It is similar to Pytest but specialized for unit testing LLM outputs. DeepEval incorporates the latest research to evaluate LLM outputs based on metrics such as G-Eval, hallucination, answer relevancy, RAGAS, etc., which uses LLMs and various other NLP models that run locally on your machine for evaluation. Whether your application is implemented via RAG or fine-tuning, LangChain, or LlamaIndex, DeepEval has you covered. With it, you can easily determine the optimal hyperparameters to improve your RAG pipeline, prevent prompt drifting, or even transition from OpenAI to hosting your own Llama2 with confidence.
In-The-Wild Jailbreak Prompts on LLMs
A dataset consists of 15,140 ChatGPT prompts from Reddit
Prompt Master
A Claude skill that writes the accurate prompts for any AI tool
DevoxxGenie
DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's
Opik
Debug, evaluate, and monitor your LLMapps, RAG systems, and agentic AI