promptfoo Files

Evaluate and compare LLM outputs, catch regressions, improve prompts

This is an exact mirror of the promptfoo project, hosted at https://github.com/promptfoo/promptfoo. SourceForge is not affiliated with promptfoo.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
0.125.1 source code.tar.gz	2026-10-25	183.7 MB	0
0.125.1 source code.zip	2026-10-25	186.9 MB	1
README.md	2026-10-25	311 Bytes	0
Totals: 3 Items		370.6 MB	1

0.125.1 (2026-10-25)

Bug Fixes

restore the authentic Discord invite (#11967) (98000c4)

Source: README.md, updated 2026-10-25

Other Useful Business Software

Ship Agents Faster

Transform your applications and workflows into powerful agentic systems at global scale.

Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.

Start Free

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Ship Agents Faster

Transform your applications and workflows into powerful agentic systems at global scale.

Start Free

Recommended Projects

DeepEval
DeepEval is a simple-to-use, open-source LLM evaluation framework, for evaluating and testing large-language model systems. It is similar to Pytest but specialized for unit testing LLM outputs. DeepEval incorporates the latest research to evaluate LLM outputs based on metrics such as G-Eval, hallucination, answer relevancy, RAGAS, etc., which uses LLMs and various other NLP models that run locally on your machine for evaluation. Whether your application is implemented via RAG or fine-tuning, LangChain, or LlamaIndex, DeepEval has you covered. With it, you can easily determine the optimal hyperparameters to improve your RAG pipeline, prevent prompt drifting, or even transition from OpenAI to hosting your own Llama2 with confidence.
In-The-Wild Jailbreak Prompts on LLMs
A dataset consists of 15,140 ChatGPT prompts from Reddit
Prompt Master
A Claude skill that writes the accurate prompts for any AI tool
Arch
Arch is an intelligent prompt gateway. Engineered with (fast) LLMs
DevoxxGenie
DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's