Agent Engineer
$100 - $500 / per-task
Verified partner opportunity
$70 - $90 / hour
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models.
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools
judging correctness, workflow soundness, and reasoning
and provide clear, rubric-based written feedback.
Basic Qualifications • 3+ years professional software development • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar) • Strong code-reading and debugging skills across full-stack or backend systems • Ability to evaluate multi-step coding trajectories for correctness and best practice
Preferred Qualifications • Experience with Kiro or Amazon CodeCatalyst • Prior work evaluating or grading AI-generated code • Contributions to developer tooling
This opportunity may suit professionals with relevant experience in AI evaluation. Review the official description and requirements before applying.
The listing states $70 - $90 / hour. Confirm the final rate, workload, and payment terms during the official application process.
Use your CV to find relevant roles on HumanitApp. This is separate from a partner application.
Match my CV →Optional role alerts from HumanitApp. Subscribe only if you want weekly emails.
Get weekly role alerts →Before you apply
The listing states $70 - $90 / hour. Confirm the final rate, workload, and payment terms during the official application process.
Yes. The button opens the exact verified Mercorlisting using the referral URL published for this role.
No. HumanitApp independently curates the opportunity. The partner platform manages applications and hiring decisions.
No. Choose the primary Apply action to continue directly without giving HumanitApp your name or email address.