Related Products
|
||||||
About
Mercor is at the intersection of labor markets and AI research. We connect human expertise with leading AI labs and enterprises to train frontier models.
Our AI benchmarks measure both economic value and consumer value:
AI Productivity Index (APEX) assesses whether frontier models are capable of performing economically valuable tasks across four jobs: investment banking associate, management consultant, big law associate, and primary care physician (MD).
AI Consumer Index (ACE) measures how frontier models handle the everyday tasks people use AI for across Shopping, Food, Gaming, and DIY.
|
About
doteval is an AI-assisted evaluation workspace that simplifies the creation of high-signal evaluations, alignment of LLM judges, and definition of rewards for reinforcement learning, all within a single platform. It offers a Cursor-like experience to edit evaluations-as-code against a YAML schema, enabling users to version evaluations across checkpoints, replace manual effort with AI-generated diffs, and compare evaluation runs on tight execution loops to align them with proprietary data. doteval supports the specification of fine-grained rubrics and aligned graders, facilitating rapid iteration and high-quality evaluation datasets. Users can confidently determine model upgrades or prompt improvements and export specifications for reinforcement learning training. It is designed to accelerate the evaluation and reward creation process by 10 to 100 times, making it a valuable tool for frontier AI teams benchmarking complex model tasks.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Frontier AI companies
|
Audience
AI researchers and engineers in search of a tool to evaluate and fine-tune large language models with precision and efficiency
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationMercor
Founded: 2023
United States
mercor.com
|
Company Informationdoteval
www.doteval.com
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Recruiting Features
Assessments
Background Screening
CRM
Interaction Tracking
Internal HR
Interview Management
Job Board Posting
Job Requisition
Onboarding
Recruiting Firms
Reference Checking
Resume Parsing
Self Service Portal
|
||||||
Integrations
YAML
|
||||||
|
|
|