E-COMMERCE ANNOTATION SPECIALIST - AI TRAINER
mercor
Part-timemid€40-50/hour
Job description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Shopify Shop App Agent Annotator
Type: Contract
Compensation: $40–$50/hour
Location: Remote
Commitment: ~5 hours/week
Role Responsibilities
• Evaluate full shopper-agent conversations, including tool calls and their outcomes.
• Identify the specific turn that received a thumbs-down from the shopper.
• Classify the issue with a primary domain tag and a specific secondary tag.
• Write concise comments explaining the shopper's intent, the agent's actions, and the rationale for the tags.
• Work independently and asynchronously to maintain consistency in tagging across conversations.
Qualifications
Must-Have
• Rule discipline to apply a fixed taxonomy consistently.
• Comfort reading structured traces to understand agent actions.
• Restraint under ambiguity to use the unknown label appropriately.
• Clear, concise written English for explaining labeling decisions.
Preferred
• Consumer e-commerce fluency in orders, tracking, and platform responsibilities.
• Prior annotation, labelling, or model-evaluation work with a defined rubric.
• Experience with the Shop app or other AI shopping assistants.
• Familiarity with customer-support operations and escalation paths.
Application Process (Takes 20–30 mins to complete)
• Upload resume
• AI interview based on your resume
• Submit form
Resources & Support
• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor