promptfoo Files

What's Changed

New Features

• feat(eval-creator): add YAML file upload support for test cases by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5054

Bug Fixes

• fix(webui): Eval results pass rate chart rendering incorrect percentages by @will-holley in https://github.com/promptfoo/promptfoo/pull/5048
• fix: improve x.ai provider error handling for 502 errors by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5051
• fix(webui): Eval results histogram improvements by @will-holley in https://github.com/promptfoo/promptfoo/pull/5059
• fix: Infinite re-render on redteam review page by @faizanminhas in https://github.com/promptfoo/promptfoo/pull/5061
• fix: sessionid(s) in extension hooks by @MrFlounder in https://github.com/promptfoo/promptfoo/pull/5053
• fix(google): handle multiple candidates in gemini response by @typpo in https://github.com/promptfoo/promptfoo/pull/5020
• fix: Bias Plugins should send config in remote generation by @faizanminhas in https://github.com/promptfoo/promptfoo/pull/5064

Chores

• chore(redteam): regenerate sessionId for each iteration in single-turn strategies by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4835
• chore: Change mcp log from error to debug by @faizanminhas in https://github.com/promptfoo/promptfoo/pull/5060
• chore: Improve telemetry by @will-holley in https://github.com/promptfoo/promptfoo/pull/5062
• chore: Add simba command by @sklein12 in https://github.com/promptfoo/promptfoo/pull/5063
• chore(webui): improve redteam setup UI with progressive disclosure for advanced options by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5028
• refactor: remove redundant dotenv from Vite app by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4983
• chore: bump version 0.117.3 by @MrFlounder in https://github.com/promptfoo/promptfoo/pull/5066
• test: CoverBot: Added tests for eval-creator components and feature flag hook (src/app) by @use-tusk[bot] in https://github.com/promptfoo/promptfoo/pull/5013

Docs

• docs(blog): grok-4 political bias post by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4953
• docs: fix cli command and remove gratuitous hover by @typpo in https://github.com/promptfoo/promptfoo/pull/5056
• docs: update user count from 100,000 to 125,000 by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5046
• docs: updates to political bias post by @typpo in https://github.com/promptfoo/promptfoo/pull/5057
• docs: improve crewai eval example by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5035
• docs: update GitHub Actions to v4 across documentation and examples by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5008
• docs: add style check guidance to CLAUDE.md by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5065

Full Changelog: https://github.com/promptfoo/promptfoo/compare/0.117.2...0.117.3