Applied Legal Benchmark Specialist

Official role description

Role Overview — We are seeking legal experts to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. — You will be assigned one of two task types: • Question Authoring — Create original, challenging multiple-choice questions in your area of legal expertise, rate their difficulty, and submit them for review. • Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. — Law Domains Covered — Intellectual Property, Privacy, and Technology, Regulatory and Government Affairs, Securities, Capital Markets, Financial Regulation & Compliance, Private Equity, M&A & Transaction Structuring, Antitrust, Merger Control & Competition, Healthcare, Life Sciences, & Pharmaceuticals, Environmental, Energy, & ESG/Climate. — Key Responsibilities • Author original law questions that test deep conceptual understanding, not surface-level recall • Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement • Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers • Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format • Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, legal repositories) • For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made — Ideal Qualifications • JD, LLM, SJD, or doctoral candidate in Law or a closely related field • Master's degree considered for candidates with exceptional depth in a specific subdomain • Strong command of legal reasoning, statutory interpretation, and jurisprudential theory • Experience with bar exam writing, legal academia, or judicial clerkships is a strong plus • Excellent written English and ability to express complex legal ideas clearly and concisely — More About the Opportunity • Expected commitment: 10+ hours/week • Asynchronous, fully remote work