+
+

Related Products

  • CompUp
    66 Ratings
    Visit Website
  • TE Recruit
    637 Ratings
    Visit Website
  • ZipRecruiter
    14,202 Ratings
    Visit Website
  • Daylight
    11 Ratings
    Visit Website
  • Canditech
    110 Ratings
    Visit Website
  • FinOpsly
    3 Ratings
    Visit Website
  • Sumsub
    227 Ratings
    Visit Website
  • Odoo
    1,705 Ratings
    Visit Website
  • Advantage
    37 Ratings
    Visit Website
  • HR Partner
    205 Ratings
    Visit Website

About

Mercor is at the intersection of labor markets and AI research. We connect human expertise with leading AI labs and enterprises to train frontier models. Our AI benchmarks measure both economic value and consumer value: AI Productivity Index (APEX) assesses whether frontier models are capable of performing economically valuable tasks across four jobs: investment banking associate, management consultant, big law associate, and primary care physician (MD). AI Consumer Index (ACE) measures how frontier models handle the everyday tasks people use AI for across Shopping, Food, Gaming, and DIY.

About

doteval is an AI-assisted evaluation workspace that simplifies the creation of high-signal evaluations, alignment of LLM judges, and definition of rewards for reinforcement learning, all within a single platform. It offers a Cursor-like experience to edit evaluations-as-code against a YAML schema, enabling users to version evaluations across checkpoints, replace manual effort with AI-generated diffs, and compare evaluation runs on tight execution loops to align them with proprietary data. doteval supports the specification of fine-grained rubrics and aligned graders, facilitating rapid iteration and high-quality evaluation datasets. Users can confidently determine model upgrades or prompt improvements and export specifications for reinforcement learning training. It is designed to accelerate the evaluation and reward creation process by 10 to 100 times, making it a valuable tool for frontier AI teams benchmarking complex model tasks.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Frontier AI companies

Audience

AI researchers and engineers in search of a tool to evaluate and fine-tune large language models with precision and efficiency

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Mercor
Founded: 2023
United States
mercor.com

Company Information

doteval
www.doteval.com

Alternatives

Alternatives

Selene 1

Selene 1

atla
Mistral Forge

Mistral Forge

Mistral AI

Categories

Categories

Recruiting Features

Assessments
Background Screening
CRM
Interaction Tracking
Internal HR
Interview Management
Job Board Posting
Job Requisition
Onboarding
Recruiting Firms
Reference Checking
Resume Parsing
Self Service Portal

Integrations

YAML

Integrations

YAML
Claim Mercor and update features and information
Claim Mercor and update features and information
Claim doteval and update features and information
Claim doteval and update features and information