AI SOFTWARE ENGINEER - TASK CURATOR
mercor
Full-timejunior€60-90/hour
Job description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software Engineering Expert
Type: Contract
Compensation: $60–$90/hour
Location: Remote
Commitment: 35 hours/week
Role Responsibilities
• Design realistic, multi-step software engineering challenges to push the limits of today's best AI coding agents.
• Build reference solutions in Python with setup and checks for clear, verifiable answers.
• Utilize AI coding assistants in your workflow to identify their strengths and limitations.
• Review tasks created by peers and provide feedback on clarity, correctness, and difficulty.
• Analyze AI agents' task attempts to help the research team understand failure points.
Qualifications
Must-Have
• MSc or PhD in computer science or a related STEM field, or equivalent practical experience.
• 1+ years in a research, research-engineering, or software engineering role.
• Strong Python scripting and debugging skills with clean-code habits.
• Proficiency with Git , IDEs, and standard software development workflows.
• Ability to engage reliably for approximately 35 hours/week .
Preferred
• Experience with AI coding assistants , prompt engineering, or agent workflows.
• Past experience in AI training , model evaluation, or benchmark/task authoring.
Resources & Support
• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Skills
PythonGitIDEs