promptfoo Files

0.121.3 (2026-03-24)

Features

• add block-no-verify PreToolUse hook to .claude/settings.json (#8234) (29a856a)
• add new config options to composite jailbreak strategy (#7693) (071d345)
• app: add manual filtering to DataTable and improve filter UX (#8122) (46dfdf5)
• assertions: add trajectory eval assertions (#8040) (6567fda)
• assertions: add trajectory tool args matching (#8142) (d0ba078)
• http: add file-based auth (#8282) (00b497c)
• providers: add skill eval support for agent SDKs (#8242) (3e2bfeb)
• providers: support GPT-5.4 mini and nano models (#8216) (8ee7547)
• providers: support new sora video sizes (#8147) (3e8af4d)
• providers: support Veo via Google AI Studio and Vertex (#8185) (c8e340d)
• support opt-out from api key checks in claude-agent-sdk (#8256) (13c040f)

Bug Fixes

• ai21: preserve zero max_tokens (#8287) (88da62a)
• anthropic: preserve zero max_tokens_to_sample (#8290) (92dd8b7)
• assertions: stabilize trajectory eval assertions (#8140) (a207119)
• cli: move success rate next to passes (#8303) (8e09d59)
• cli: prevent API error logs from corrupting progress bar display (#7646) (8aa4e42)
• deps: update anthropic packages (#8249) (15efcd7)
• deps: update dependency @anthropic-ai/sdk to ^0.80.0 (#8281) (33d738f)
• deps: update dependency @openai/agents to ^0.6.0 (#8179) (d221767)
• deps: update dependency @openai/agents to ^0.7.0 (#8189) (08a2c12)
• deps: update dependency @tanstack/react-virtual to ^3.13.22 (#8201) (63cc2b1)
• deps: update dependency better-sqlite3 to ^12.8.0 (#8221) (7ffc164)
• deps: update dependency fast-xml-parser to ^5.5.0 (#8168) (c1e0dcb)
• deps: update dependency fast-xml-parser to ^5.5.3 (#8169) (ce1e672)
• deps: update dependency fast-xml-parser to ^5.5.4 (#8205) (ab66e52)
• deps: update dependency fast-xml-parser to ^5.5.5 (#8210) (ca3d586)
• deps: update dependency lightningcss to ^1.32.0 (#8149) (a5c5c3b)
• deps: update dependency lru-cache to ^11.2.7 (#8215) (3065be9)
• deps: update dependency openai to ^6.32.0 (#8269) (c7d7825)
• deps: update dependency proxy-agent to v7 (#8186) (87affda)
• deps: update dependency proxy-from-env to ^2.1.0 (#8229) (8b4b542)
• deps: update dependency simple-git to ^3.33.0 (#8170) (39aee24)
• deps: update example dependencies (#8248) (53d5ab6)
• deps: update openai packages (#8212) (42e523a)
• deps: update openai packages (#8268) (ac24038)
• elevenlabs: preserve agents maxTurns zero (#8285) (36ce694)
• envars: use explicit undefined check in getEnvInt and getEnvFloat (#8182) (f3215e5)
• examples: use append_allowed_tools in plugins example (#8143) (3510ba8)
• http: expose oauth token in vars (#8304) (fee4bc0)
• mistral: handle tool call responses where content is null (#8165) (9c93471)
• providers: add gpt-5.4 mini and nano support (#8219) (68c1961)
• providers: add requiresApiKey() to claude-agent-sdk for Vertex/Bedrock support (#8132) (49af17b)
• providers: support gpt-5.4 in codex provider (#8228) (ee7ae2c)
• providers: use merged env for claude-agent-sdk provider registration (#8134) (456199c)
• providers: use nullish coalescing for temperature in Anthropic Messages and LocalAI (#8163) (94adbe1)
• providers: use nullish coalescing for temperature with provider-scoped env support (#8167) (3b20e2b)
• redteam: de-alias generated redteam examples (#8241) (6117b52)
• redteam: fix Rules of Hooks violation in RiskCategoryDrawer (#8072) (afb2732)
• redteam: preserve voice crescendo zero max backtracks (#8296) (0d3e4b7)
• replicate: preserve zero-valued config (#8128) (14890e6)