promptfoo Files

What's Changed

Fixes

• fix: Windows Python path validation race condition by @benbuzz790 in https://github.com/promptfoo/promptfoo/pull/4485
• fix: View results as evaluation runs by @sklein12 in https://github.com/promptfoo/promptfoo/pull/4459

Chores

• chore: refactor modifiers and apply to all plugins by @faizanminhas in https://github.com/promptfoo/promptfoo/pull/4454
• chore(cli): update plugin severity overrides API endpoint by @will-holley in https://github.com/promptfoo/promptfoo/pull/4460
• chore(webui): fix text length reset value to use reasonable default by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4469
• chore(webui): remove unused hook files by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4470
• chore: remove unused token usage utilities by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4471
• chore: convert console.logs to logger by @typpo in https://github.com/promptfoo/promptfoo/pull/4479
• chore: improve tusk workflow by @sohil-kshirsagar in https://github.com/promptfoo/promptfoo/pull/4461
• chore: bump version to 0.115.1 by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4520

Dependencies

• chore(deps): bump @aws-sdk/client-bedrock-runtime from 3.828.0 to 3.830.0 by @dependabot in https://github.com/promptfoo/promptfoo/pull/4519
• chore(deps): bump @azure/identity from 4.10.0 to 4.10.1 by @dependabot in https://github.com/promptfoo/promptfoo/pull/4477
• chore(deps): bump openai from 5.3.0 to 5.5.0 by @dependabot in https://github.com/promptfoo/promptfoo/pull/4518
• chore(deps): update zod to 3.25.63 and zod-validation-error to 3.5.0 by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4463

Documentation

• docs: add log file location section to troubleshooting guide by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4473
• docs: capitalize Promptfoo by @typpo in https://github.com/promptfoo/promptfoo/pull/4515
• docs: update red-teaming agent blog post title by @sklein12 in https://github.com/promptfoo/promptfoo/pull/4497
• docs: improve installation and getting-started pages with tabbed interface and SEO metadata by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4395
• docs: improve Python provider documentation by @typpo in https://github.com/promptfoo/promptfoo/pull/4484
• docs: add ModelAudit binary formats documentation by @typpo in https://github.com/promptfoo/promptfoo/pull/4500
• docs: update ModelAudit documentation by @typpo in https://github.com/promptfoo/promptfoo/pull/4514
• docs: add ModelAudit weighted distribution scanner documentation by @typpo in https://github.com/promptfoo/promptfoo/pull/4501
• docs: add ModelAudit ZIP feature documentation by @typpo in https://github.com/promptfoo/promptfoo/pull/4491
• docs: separate pages for prompts, test cases, and outputs by @typpo in https://github.com/promptfoo/promptfoo/pull/4505
• docs: update model reference in guide.md by @aaronccasanova in https://github.com/promptfoo/promptfoo/pull/4513
• docs(blog): add new redteam agent documentation by @sklein12 in https://github.com/promptfoo/promptfoo/pull/4494
• docs(examples): fix custom-grader-csv README inconsistencies by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4474
• docs(site): add llms.txt mentions and documentation standards by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4481
• docs(site): add robots.txt by @mldangelo in https://github.com/promptfoo/promptfoo/pull/4488
• docs: fix typo in blog post by @sklein12 in https://github.com/promptfoo/promptfoo/pull/4496
• docs: update title on blog post by @sklein12 in https://github.com/promptfoo/promptfoo/pull/4495

Testing

• test: add unit test for src/util/cloud.ts by @gru-agent in https://github.com/promptfoo/promptfoo/pull/4462
• test: add unit test for src/util/convertEvalResultsToTable.ts by @gru-agent in https://github.com/promptfoo/promptfoo/pull/4457

New Contributors

• @sohil-kshirsagar made their first contribution in https://github.com/promptfoo/promptfoo/pull/4461
• @aaronccasanova made their first contribution in https://github.com/promptfoo/promptfoo/pull/4513

Full Changelog: https://github.com/promptfoo/promptfoo/compare/0.115.0...0.115.1