promptfoo Files

What's Changed

New Features

• feat(providers): Add support for Meta Llama API provider by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5432
• feat(providers): Support TLS certs in http provider by @faizanminhas in https://github.com/promptfoo/promptfoo/pull/5452
• feat(providers): add support for xAI Grok Code Fast models by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5425

Bug Fixes

• fix(sharing): Share when it's enabled via the Config or the CLI command by @sklein12 in https://github.com/promptfoo/promptfoo/pull/5404
• fix: Update util.ts to reflect correct Anthropic Haiku 3.5 pricing by @capttrousers in https://github.com/promptfoo/promptfoo/pull/5436
• fix(grader): reduce grader false positives by @typpo in https://github.com/promptfoo/promptfoo/pull/5431

Chores

• chore: drop Node.js 18 support by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5428
• chore(http): improve PFX debug logging + tests by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5445
• chore(webui): Show footer on custom metrics dialog by @will-holley in https://github.com/promptfoo/promptfoo/pull/5424
• chore: silence dotenv commercial logging messages by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5453
• chore: remove example by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5420
• test: CoverBot: Added tests for analytics tracking and red team reporting components (src/app) by @use-tusk[bot] in https://github.com/promptfoo/promptfoo/pull/5441
• test: optimize Python Unicode test suite for CI reliability by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5449

Docs

• docs(site): add more guardrails assertion doc by @MrFlounder in https://github.com/promptfoo/promptfoo/pull/5434
• docs(site): add multi-lingual RAG evaluation guidance by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5447
• docs(site): optimize OG image generation performance by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5451
• docs(site): update blog post by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5422

Dependencies

• chore: bump the github-actions group with 3 updates by @dependabot[bot] in https://github.com/promptfoo/promptfoo/pull/5440
• chore: update dependencies (non-breaking) by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5448
• chore: update dependencies to latest minor/patch versions by @mldangelo in https://github.com/promptfoo/promptfoo/pull/5433

New Contributors

• @capttrousers made their first contribution in https://github.com/promptfoo/promptfoo/pull/5436

Full Changelog: https://github.com/promptfoo/promptfoo/compare/0.118.1...0.118.2