FINANCE SME - AI EVALUATION EXPERT

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance Specialist Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities • Guide research and engineering teams to close knowledge gaps in financial reasoning, analysis, and decision-making. • Design challenging, domain-relevant finance tasks and write accurate, well-reasoned solutions grounded in real financial practice. • Evaluate AI model outputs against structured rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality. • Develop and refine evaluation guidelines and scoring rubrics specific to finance tasks. • Collaborate with other subject matter experts to ensure consistency and accuracy in training data. Qualifications Must-Have • 8+ years of dedicated professional experience in finance (e.g., investment banking, asset management, corporate finance, financial advisory) at a recognized, top-tier organization (e.g., Goldman Sachs, JPMorgan, Morgan Stanley, BlackRock, Fidelity, Deloitte, PwC, EY, KPMG, or equivalent). • Prior hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria. • Demonstrable career progression (e.g., Analyst → Associate → VP/Director). • Ability to engage reliably for at least 35 hours/week during weekdays. • Verbal and written communication skills, problem-solving skills, and interpersonal skills. Application Process (Takes 20–30 mins to complete) • Upload resume • AI interview based on your resume • Submit form Resources & Support • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome • For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.