Ragas Files

What's Changed

• feat: migrate SQLSemanticEquivalence to collections API by @anistark in https://github.com/vibrantlabsai/ragas/pull/2496
• feat: migrate DataCompyScore to collections API by @anistark in https://github.com/vibrantlabsai/ragas/pull/2499
• fix: migrate CHRF Score to new metrics collections by @anistark in https://github.com/vibrantlabsai/ragas/pull/2500
• Feat/improve rag quickstart by @anistark in https://github.com/vibrantlabsai/ragas/pull/2501
• fix: handle classification array length mismatch in TopicAdherence metric by @anistark in https://github.com/vibrantlabsai/ragas/pull/2503
• feat: migrate quoted spans metric to collections api by @anistark in https://github.com/vibrantlabsai/ragas/pull/2504
• fix: handle instructor modes for json and tools by @anistark in https://github.com/vibrantlabsai/ragas/pull/2505
• docs: remove obsolete 'write your own metric' guides by @sanjeed5 in https://github.com/vibrantlabsai/ragas/pull/2488
• fix: BasePrompt.adapt() structured output + language adaptation guide by @sanjeed5 in https://github.com/vibrantlabsai/ragas/pull/2487
• Add AG-UI Protocol Integration for Agent Evaluation by @contextablemark in https://github.com/vibrantlabsai/ragas/pull/2395
• docs: fix modifying-prompts-metrics guide with correct API by @sanjeed5 in https://github.com/vibrantlabsai/ragas/pull/2486
• fix: handle nested dicts/lists in ToolCallF1 args to prevent unhashable type error by @anistark in https://github.com/vibrantlabsai/ragas/pull/2507
• feat: add Claude docs auto-update workflow by @sanjeed5 in https://github.com/vibrantlabsai/ragas/pull/2508
• fix: allow unannotated parameters to accept any type by @dhyaneesh in https://github.com/vibrantlabsai/ragas/pull/2513
• feat: migrate MultiModalFaithfulness to collections API by @anistark in https://github.com/vibrantlabsai/ragas/pull/2515
• feat: migrate MultiModalRelevance to collections API by @anistark in https://github.com/vibrantlabsai/ragas/pull/2518
• feat: add support for new google-genai SDK with backwards compatibility for deprecated google-generativeai by @anistark in https://github.com/vibrantlabsai/ragas/pull/2517
• fix: use instructor Mode.JSON for litellm and generic providers to fix Dict type validation errors by @anistark in https://github.com/vibrantlabsai/ragas/pull/2514
• [AG-UI] Replacing "OpenAI" with "AsyncOpenAI". by @contextablemark in https://github.com/vibrantlabsai/ragas/pull/2520
• Feat: document PDF export workflow by @cgaswin in https://github.com/vibrantlabsai/ragas/pull/2522
• refactor: deprecate legacy metrics by @anistark in https://github.com/vibrantlabsai/ragas/pull/2519
• fix: claude workflows to use github token by @anistark in https://github.com/vibrantlabsai/ragas/pull/2527
• feat: add HuggingFace tokenizer support in knowledge graph operations by @anistark in https://github.com/vibrantlabsai/ragas/pull/2524
• feat: add generate_with_chunks for pre-chunked documents by @MinseongS in https://github.com/vibrantlabsai/ragas/pull/2526
• feat(docs): add offline mermaid support to PDF export by @cgaswin in https://github.com/vibrantlabsai/ragas/pull/2530
• fix: claude workflows to use pat token instead of github token to support forked PRs by @anistark in https://github.com/vibrantlabsai/ragas/pull/2531
• docs: change query execution to use asyncio.run by @yangzq50 in https://github.com/vibrantlabsai/ragas/pull/2532
• fix: increase max-turns and update prompt by @anistark in https://github.com/vibrantlabsai/ragas/pull/2534
• chore: remove survey link by @anistark in https://github.com/vibrantlabsai/ragas/pull/2535
• feat: add caching support for metrics collections by @anistark in https://github.com/vibrantlabsai/ragas/pull/2533
• feat: add caching support for embeddings by @anistark in https://github.com/vibrantlabsai/ragas/pull/2536

New Contributors

• @contextablemark made their first contribution in https://github.com/vibrantlabsai/ragas/pull/2395
• @cgaswin made their first contribution in https://github.com/vibrantlabsai/ragas/pull/2522
• @MinseongS made their first contribution in https://github.com/vibrantlabsai/ragas/pull/2526
• @yangzq50 made their first contribution in https://github.com/vibrantlabsai/ragas/pull/2532

Full Changelog: https://github.com/vibrantlabsai/ragas/compare/v0.4.1...v0.4.2