Finance & Insurance Practice Reviewer

Official role description

The role

We're hiring working finance and insurance professionals to audit AI work product in their own field, not to produce it.

You'll see an AI agent's complete attempt at a realistic task from your job: the task as written, what the agent did, the files it produced, and the scoresheet an AI grader filled in afterwards. You bring the judgment of someone who does this work for a living, and answer four questions:

1. Is this a real task? Would it come up in this job, described this way? Realistic, borderline, or contrived. 2. Is the domain content right? Are the standards, figures, regulations and constraints accurate and consistent, or is something subtly wrong in a way only a practitioner would catch? 3. Does the grading hold up? The grader answered eleven yes/no questions about the finished work: correct format, fabricated figures, requirements met, terminology, and so on. You go through them with the files open and say where you disagree, and why. 4. Is the score defensible? Band the work yourself. Could a practitioner use it? Accept it? Then check the reported score against your band.

About an hour per item. You never perform the task or redo the agent's work.

Who we're looking for

Five roles. Apply to the one that's actually yours: • Financial Managers. Controllers, FP&A leads, treasury or finance directors. 5+ years owning a budget, a forecast or the close. • Securities, Commodities & Financial Services Sales Agents. Active Series 7 plus 63 or 66, and 4+ years placing trades or running your own book. • Personal Financial Advisors. 4+ years advising your own client households. CFP or Series 65 preferred. • Financial & Investment Analysts. 3+ years building models that someone actually made decisions on. CFA a plus. • Customer Service Representatives. 4+ years on a bank, brokerage or insurance carrier service desk, handling claims, policy changes or account servicing.

We want people who know the field cold: anyone who has reviewed a junior's model, signed off on a suitability file, or sat through an audit or a regulatory exam. Less of a fit are people who read research without ever producing it, and equivalents from outside the US market, since the tasks turn on SEC, FINRA and US state insurance specifics.

Also required: near-native business English, because you write a short reason for every judgment, and enough comfort with a spreadsheet or PDF to check whether the numbers in it reconcile.