promptfoo Files

Evaluate and compare LLM outputs, catch regressions, improve prompts

This is an exact mirror of the promptfoo project, hosted at https://github.com/promptfoo/promptfoo. SourceForge is not affiliated with promptfoo.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
0.121.0 source code.tar.gz	2026-03-09	176.8 MB	0
0.121.0 source code.zip	2026-03-09	179.4 MB	0
README.md	2026-03-09	2.7 kB	0
Totals: 3 Items		356.2 MB	0

0.121.0 (2026-03-09)

⚠ BREAKING CHANGES

providers: resolve relative config paths against config dir in claude-agent-sdk (#8030)

Features

redteam: generalize insurance plugins for all insurance types (#8002) (945c3bc)
stop multi-turn redteam attacks when target closes thread (#7942) (d849923)

Bug Fixes

app: enforce strategy config limits via onChange clamping (#8045) (9b8920d)
app: restore composite jailbreak strategy visibility (#8013) (a34ec66)
ci: skip email verification API call in CI environments (#8034) (594a4a7)
cli: cap agent fs reads before loading file (#8050) (d39c41b)
deps: update dependency @opencode-ai/sdk to ^1.2.19 (#8052) (995f94c)
deps: update dependency fast-xml-parser to ^5.4.2 (#8042) (8be46a5)
deps: update opentelemetry (#8056) (6b4ed86)
make quoted comma parsing consistent across contains assertions (#8041) (3c1ad55)
providers: resolve relative config paths against config dir in claude-agent-sdk (#8030) (2e8a976)

Source: README.md, updated 2026-03-09

Other Useful Business Software

Gemini 3 and 200+ AI Models on One Platform Icon

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Try Google Cloud Risk-Free With $300 in Credit Icon

Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.

Start Free

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Recommended Projects

Simple Evals
Lightweight framework for evaluating large language model performance
DeepEval
DeepEval is a simple-to-use, open-source LLM evaluation framework, for evaluating and testing large-language model systems. It is similar to Pytest but specialized for unit testing LLM outputs. DeepEval incorporates the latest research to evaluate LLM outputs based on metrics such as G-Eval, hallucination, answer relevancy, RAGAS, etc., which uses LLMs and various other NLP models that run locally on your machine for evaluation. Whether your application is implemented via RAG or fine-tuning, LangChain, or LlamaIndex, DeepEval has you covered. With it, you can easily determine the optimal hyperparameters to improve your RAG pipeline, prevent prompt drifting, or even transition from OpenAI to hosting your own Llama2 with confidence.
Opik
Debug, evaluate, and monitor your LLMapps, RAG systems, and agentic AI
Prompt Master
A Claude skill that writes the accurate prompts for any AI tool
Enchanted
Enchanted is iOS and macOS app for chatting with language models