HumanitApp
  • Home
  • Roles
  • Weekly
  • Role Match
  • Tools
  • Saved
Submit CVGet weekly role alerts
← Back to all roles

Verified partner opportunity

Study Domain Expert — Judge Calibration — Sales

$90 / hour

MercorRemote - location not specifiedHourly contract

Role Overview

Is this a fit?

  • You can show recent, specific work involving AI evaluation.
  • The listed commitment of 13 hours/week fits your schedule.
  • You can communicate your reasoning clearly in the application language.

Apply on Mercor

Complete your application with Mercor. No HumanitApp account or fee.

What happens next

  1. Continue to the official listing and enter your application details; have your resume ready.
  2. Complete the role-specific screen or assessment requested by the partner.
  3. Confirm availability, location eligibility and work authorization if requested. The partner determines the exact process.

Last verified 2026-09-10

Exact listing verified. HumanitApp is independent from Mercor and may receive a referral fee; the partner controls assessment and hiring.

Read our Mercor review
Ready to continue?Study Domain Expert — Judge Calibration — Sales

Official role description

Role Overview

Mercor is sourcing Sales experts for a structured judge-calibration study. You will apply professional judgment to realistic Sales work and evaluate model-generated outputs.

What You'll Do • Sign an NDA before receiving study materials. • Complete one realistic Sales task using supplied source files. • Review model outputs, rank and score them, and write evidence-based rationales. • Provide structured feedback on the task and study design.

Time Commitment 13 hours during September 12–15, 2026.

Quality Criteria • More than 5 years of experience in Sales or a closely relevant field, ideally at a high-caliber firm. • Ideally held a manager, director, or principal-level Sales role; entry-level experience alone is insufficient. • Fluent or native English. • Prior work as an expert is a plus. • No geographic restrictions.

Study Conditions and Eligibility • No use of LLMs or other AI assistants during the study. • People who have worked on Project Alchemy in any capacity or accessed its source-world data are not eligible.

Relevant skills

AI evaluation

Who this role may fit

This opportunity may suit professionals with relevant experience in AI evaluation. Review the official description and requirements before applying.

Compensation context

The listing states $90 / hour. Confirm the final rate, workload, and payment terms during the official application process.

Qualification checklist

  • You can show recent, specific work involving AI evaluation.
  • The listed commitment of 13 hours/week fits your schedule.
  • You can communicate your reasoning clearly in the application language.
  • You are comfortable with project availability and hours varying over time.

Not the right fit?

Use your CV to find relevant roles on HumanitApp. This is separate from a partner application.

Match my CV →

New roles, once a week.

Optional role alerts from HumanitApp. Subscribe only if you want weekly emails.

Get weekly role alerts →

Before you apply

Referral and application questions

How should I compare the listed pay?

The listing states $90 / hour. Confirm the final rate, workload, and payment terms during the official application process.

Does Apply use a referral link?

Yes. The button opens the exact verified Mercorlisting using the referral URL published for this role.

Is HumanitApp the employer?

No. HumanitApp independently curates the opportunity. The partner platform manages applications and hiring decisions.

Must I share my details here?

No. Choose the primary Apply action to continue directly without giving HumanitApp your name or email address.

Continue exploring

Related verified roles

View category
Business

UK-Based Sales Experts

$140 - $200 / hour

Business

UK-Based MBB and Top-Tier Strategy Consulting Experts

$140 - $200 / hour

Business

Compensation & Equity Expert (Total Rewards)

$50 - $200 / hour

Business

Management Consultant Talent Network

$100 - $150 / hour