We are looking for engineers who build and operate LLM agents in production, and who have real visibility into how agents are actually used inside a company. — You have probably: • Shipped an agent that real users...
Human expertise, applied
Browse 354 curated AI evaluation and annotation roles. Every listing includes a direct referral path.
Get new roles in your inbox — free, weekly. Join 200+ people already getting weekly role drops.
We are looking for engineers who build and operate LLM agents in production, and who have real visibility into how agents are actually used inside a company. — You have probably: • Shipped an agent that real users...
1. Role Overview — Mercor is seeking GPU kernel optimization experts to contribute to a project with a leading AI lab. This opportunity is designed for freelancers with strong C++ skills, practical GPU programming...
About the Opportunity — A leading AI research organization is seeking advanced LLM power users with strong experience using MCP and (more importantly) plugins/connectors for real-world personal life tasks. — This...
About the role We're building a high-quality evaluation dataset for CNC manufacturing and are looking for experienced CAM programmers to author grading rubrics for Fusion 360 CAM programs. You'll create text-only,...
1. Role Overview — Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work....
1. Role Overview — Mercor is partnering with a leading AI research organization to engage experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital...
We're looking for engineers who have shipped production search systems (especially agentic ones now that we're in the era of LLMs and agents) and are thinking hard about the requirements and optimizations of those...
Mercor is building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data...
We're looking for experienced machine learning researchers with hands-on experience training and improving deep learning models end-to-end, across vision and language. You'll work on well-scoped empirical open-ended ML...
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models. — 1. Overview — Join a leading AI lab's...
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models. — 1. Overview — Join a leading AI lab's...
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models. — 1. Overview — We're seeking talented...
Mercor is working with a leading AI research lab to improve the capabilities of next-generation AI systems. We are seeking experienced Risk Adjustment and HCC Coding leaders to evaluate AI tools designed to improve risk...
About the role — We are hiring expert Evaluators in Document/deck production QA to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You...
Bioinformatics & Computational Single-Cell Genomics Expert — About the Project — We're building a large-scale benchmark to test how well advanced AI systems can solve hard scientific and engineering problems. As a task...
About the work — We're building a high-quality dataset of human preference judgments on AI-generated frontend code. You'll be shown a reference web page alongside two candidate replications produced by AI models, and...
Computational Statistics and Applied Mathematics Expert — About the Project — We're building a large-scale benchmark to test how well advanced AI systems can solve hard scientific and engineering problems. As a task...
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced AI models. — 1. Overview — A leading AI lab is building the next...
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced AI models. — 1. Overview — A leading AI lab is building the next...
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced AI models. — 1. Overview — A leading AI lab is building the next...
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced AI models. — 1. Overview — A leading AI lab is building the next...
Join a growing network of industry experts supporting AI research and development. — Overview — We're building a select group of experienced civil engineers to help evaluate and improve how AI systems understand and...
Join a growing network of industry experts supporting AI research and development. — Overview — We're building a select group of experienced chemical engineers to help evaluate and improve how AI systems understand and...
Join a growing network of industry experts supporting AI research and development. — Overview — We're building a select group of experienced mechanical engineers to help evaluate and improve how AI systems understand...
Join a growing network of industry experts supporting AI research and development. — Overview — We're building a select group of experienced electrical engineers to help evaluate and improve how AI systems understand...
About the Role — You've been selected for ScreenSpot Plus, where you'll capture screenshots of professional CAD software in realistic, expert use, annotate interactive UI elements, and write natural-language task...
Role Overview • Mercor is seeking senior litigation professionals to build evaluation tasks for AI systems operating in civil litigation and dispute resolution contexts. • The workflows are calibrated to the case...
Electrical Engineering & RF/Circuit Design Expert — About the Project — We're building a large-scale benchmark to test how well advanced AI systems can solve hard scientific and engineering problems. As a task designer,...
Computational Structural & Mechanical Engineering Expert — About the Project — We're building a large-scale benchmark to test how well advanced AI systems can solve hard computational scientific and engineering...
Role Overview — We are seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across...
Mercor is seeking experts in Atomic Layer Deposition (ALD) and thin-film processes to support a frontier AI research lab building models for semiconductors and the physical sciences. This is hands-on, expert-level work:...
About the Role — \- Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. — \- Contributors help evaluate and improve frontier AI coding models through structured technical...
Overview — We're looking to rapidly assemble a small group of world-class machine learning researchers for an initial pilot. This is a high-priority engagement with an accelerated timeline, so both exceptional candidate...
About the Role — \- Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. — \- Contributors help evaluate and improve frontier AI coding models through structured technical...
Role Overview • Mercor is seeking senior cybersecurity professionals to build evaluation tasks for AI systems operating in security operations, incident response, and risk management contexts. • The workflows are...
Mercor is working with a leading AI research lab to improve the capabilities of next-generation AI systems. We are seeking experienced Coding Managers and HIM Coding leaders to evaluate AI-powered coding solutions and...
About the Role — \- Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. — \- Contributors help evaluate and improve frontier AI coding models through structured technical...
Role Overview — We are seeking expert engineers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core...
Role Overview • Mercor is seeking senior civil engineering professionals to build evaluation tasks for AI systems operating in large-scale infrastructure and construction contexts. • The workflows are calibrated to the...
Are you a Level 3 / Tier 3 network support engineer interested in data science and autonomous infrastructure? Our client is building vertically integrated networking systems and using the data they generate to power the...
Mercor is seeking computational scientists specializing in atomistic and surface modeling to support a frontier AI research lab building models for materials science and the physical sciences. This is hands-on,...
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models. — 1. Overview — Join a leading AI lab's...
Mercor is seeking experimental scientists and engineers across inorganic synthesis, characterization, superconductors, and semiconductors (including advanced packaging) to support a frontier AI research lab building...
Write original general-knowledge multiple-choice questions in Norwegian for an AI evaluation dataset. — You will draft exam-style questions from your own expertise, each with ten answer options and a worked solution....
Overview We're looking for audio engineers with strong experience editing and quality-checking voice recordings for speech and text-to-speech (TTS) applications, specifically for German-language audio. This role focuses...
Overview We're looking for audio engineers with strong experience editing and quality-checking voice recordings for speech and text-to-speech (TTS) applications, specifically for French-language audio. This role focuses...
Write original general-knowledge multiple-choice questions in Chinese (Simplified) for an AI evaluation dataset. — You will draft exam-style questions from your own expertise, each with ten answer options and a worked...
Write original general-knowledge multiple-choice questions in Chinese (Traditional) for an AI evaluation dataset. — You will draft exam-style questions from your own expertise, each with ten answer options and a worked...
Write original general-knowledge multiple-choice questions in Czech for an AI evaluation dataset. — You will draft exam-style questions from your own expertise, each with ten answer options and a worked solution....
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models. — 1. Overview — Join a leading AI lab's...
HumanitApp removes the noise between finding a relevant role and reaching the application.
Search vetted AI roles by domain, location, work type, and pay.
Check the source, role context, and compensation before applying.
Use the referral-ready application link included on every listing.
Private by default: submitted CVs are used for role matching, never sold, and never added to marketing blasts.
354 roles live
Browse now