Ragas Files

What's Changed

• docs: complete collections API documentation for remaining metrics by @sanjeed5 in https://github.com/vibrantlabsai/ragas/pull/2420
• feat: support GPT-5 and o-series models with automatic temperature and top_p constraint handling by @anistark in https://github.com/vibrantlabsai/ragas/pull/2418
• update: add llm options as tabs to quickstart by @anistark in https://github.com/vibrantlabsai/ragas/pull/2421
• feat: migrate to instructor.from_provider for universal provider support by @anistark in https://github.com/vibrantlabsai/ragas/pull/2424
• docs: fix typos in some files by @Edge-Seven in https://github.com/vibrantlabsai/ragas/pull/2429
• feat: implement prompt class for context precision by @anistark in https://github.com/vibrantlabsai/ragas/pull/2433
• fix: docs for quickstart by @anistark in https://github.com/vibrantlabsai/ragas/pull/2434
• Fix 2432: Update import statements for langchain modules by @rvernica in https://github.com/vibrantlabsai/ragas/pull/2436
• Fix 2440 Adjust LLM parameters in evals.py by @rvernica in https://github.com/vibrantlabsai/ragas/pull/2441
• feat: migrate context recall, answer relevancy, and context entity recall metrics to modular BasePrompt architecture by @anistark in https://github.com/vibrantlabsai/ragas/pull/2435
• feat: migrate 6 metrics (ContextRelevance, Response Groundedness, AnswerAccuracy, Faithfulness, AnswerCorrectness, SummaryScore) to BasePrompt by @anistark in https://github.com/vibrantlabsai/ragas/pull/2443
• feat: migrate final metrics (FactualCorrectness, NoiseSensitivity) to modular BasePrompt architecture and update docs by @anistark in https://github.com/vibrantlabsai/ragas/pull/2444
• chore: add COC by @anistark in https://github.com/vibrantlabsai/ragas/pull/2437
• docs: clarify MLflow is required, not optional in RAG evaluation guide by @anistark in https://github.com/vibrantlabsai/ragas/pull/2447
• chore: cleanup old patterns and update links by @anistark in https://github.com/vibrantlabsai/ragas/pull/2449
• chore: rebranding efforts by @jjmachan in https://github.com/vibrantlabsai/ragas/pull/2445
• feat: dual adapter support (Instructor + LiteLLM) by @anistark in https://github.com/vibrantlabsai/ragas/pull/2446
• fix: resolve InstructorLLM detection bug and add EvaluationDataset backend support for experiments by @anistark in https://github.com/vibrantlabsai/ragas/pull/2451
• fix: retrieved_contexts string filtering in LangChain integration by @dhyaneesh in https://github.com/vibrantlabsai/ragas/pull/2452
• fix: correct MultiTurnSample user_input validation logic by @harshil-sanghvi in https://github.com/vibrantlabsai/ragas/pull/2426
• fix: automatic embedding provider matching for LLMs by @anistark in https://github.com/vibrantlabsai/ragas/pull/2454
• fix: make GitPython an optional dependency by @anistark in https://github.com/vibrantlabsai/ragas/pull/2453
• docs: Update customizations how-to guides to use collections API and LLM factory by @sanjeed5 in https://github.com/vibrantlabsai/ragas/pull/2425
• fix: detect async clients in closures for instructor-wrapped litellm routers by @anistark in https://github.com/vibrantlabsai/ragas/pull/2458
• fix: quickstart by @anistark in https://github.com/vibrantlabsai/ragas/pull/2463
• chore: update calendar email by @anistark in https://github.com/vibrantlabsai/ragas/pull/2462
• fix: make GoogleEmbeddings handle GenerativeModel clients by auto-extracting genai module by @anistark in https://github.com/vibrantlabsai/ragas/pull/2466
• docs: add migration guide for v0.4 by @anistark in https://github.com/vibrantlabsai/ragas/pull/2461

New Contributors

• @Edge-Seven made their first contribution in https://github.com/vibrantlabsai/ragas/pull/2429
• @rvernica made their first contribution in https://github.com/vibrantlabsai/ragas/pull/2436
• @dhyaneesh made their first contribution in https://github.com/vibrantlabsai/ragas/pull/2452

Full Changelog: https://github.com/vibrantlabsai/ragas/compare/v0.3.9...v0.4.0