Prometheus-Eval Files

Evaluate your LLM's response with Prometheus and GPT4

This is an exact mirror of the Prometheus-Eval project, hosted at https://github.com/prometheus-eval/prometheus-eval. SourceForge is not affiliated with Prometheus-Eval.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2024-09-02	766 Bytes	0
v0.1.20 source code.tar.gz	2024-09-02	12.8 MB	0
v0.1.20 source code.zip	2024-09-02	13.0 MB	0
Totals: 3 Items		25.7 MB	0

What's Changed

Bump aiohttp from 3.9.5 to 3.10.2 in /libs/prometheus-eval by @dependabot in https://github.com/prometheus-eval/prometheus-eval/pull/54
Bump litellm from 1.40.0 to 1.40.16 in /BiGGen-Bench by @dependabot in https://github.com/prometheus-eval/prometheus-eval/pull/53
Bump urllib3 from 2.2.1 to 2.2.2 in /BiGGen-Bench by @dependabot in https://github.com/prometheus-eval/prometheus-eval/pull/55
Fix for wrong parsing of score results by @rafaelliu in https://github.com/prometheus-eval/prometheus-eval/pull/59

New Contributors

@rafaelliu made their first contribution in https://github.com/prometheus-eval/prometheus-eval/pull/59

Full Changelog: https://github.com/prometheus-eval/prometheus-eval/compare/v0.1.19...v0.1.20

Source: README.md, updated 2024-09-02

Other Useful Business Software

$300 in Free Credit Towards Top Cloud Services Icon

$300 in Free Credit Towards Top Cloud Services

Build VMs, containers, AI, databases, storage—all in one place.

Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.

Get Started

MongoDB Atlas runs apps anywhere Icon

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

$300 in Free Credit Towards Top Cloud Services

Build VMs, containers, AI, databases, storage—all in one place.

Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.

Get Started

Recommended Projects

ImageReward
[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences
RLHF-Reward-Modeling
Recipes to train reward model for RLHF
H2O LLM Studio
Framework and no-code GUI for fine-tuning LLMs
promptfoo
Evaluate and compare LLM outputs, catch regressions, improve prompts
DeepEval
DeepEval is a simple-to-use, open-source LLM evaluation framework, for evaluating and testing large-language model systems. It is similar to Pytest but specialized for unit testing LLM outputs. DeepEval incorporates the latest research to evaluate LLM outputs based on metrics such as G-Eval, hallucination, answer relevancy, RAGAS, etc., which uses LLMs and various other NLP models that run locally on your machine for evaluation. Whether your application is implemented via RAG or fine-tuning, LangChain, or LlamaIndex, DeepEval has you covered. With it, you can easily determine the optimal hyperparameters to improve your RAG pipeline, prevent prompt drifting, or even transition from OpenAI to hosting your own Llama2 with confidence.