BILINGUAL EVALUATOR - INTERNET CULTURE EXPERT
mercor
Part-timemid€25-25/hour
Job description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Internet-Native Bilingual Evaluator Expert (Spanish – Latin America)
Type: Contract
Compensation: $25/hour
Location: Remote
Commitment: 10–20 hours/week
Role Responsibilities
• Evaluate AI model outputs across English and Spanish to ensure accuracy in modern online communication, cultural references, and multilingual interactions.
• Analyse content from social media, forums, and online communities for naturalness, fluency, and cultural appropriateness.
• Identify issues with slang, memes, abbreviations, and evolving online language specific to Latin American internet culture.
• Develop detailed rubrics and guidelines for evaluating bilingual and internet-native communication.
• Test language models using real-world multilingual prompts and provide structured feedback to improve model performance.
• Collaborate with project leads to maintain consistency across datasets and improve evaluation frameworks.
Qualifications
Must-Have
• Native or near-native fluency in Latin American Spanish and professional fluency in English.
• Deep familiarity with internet culture and online communities in Spanish-speaking countries in Latin America.
• Active engagement with platforms like YouTube , TikTok , Reddit , Discord , Instagram , Twitch , Facebook , and WhatsApp .
• Strong understanding of Latin American Spanish slang, memes, and digital culture.
• Strong writing, analytical, and critical thinking skills.
Preferred
• Experience in content moderation, localisation, translation, linguistics, social media, journalism, or AI evaluation .
• Familiarity with regional linguistic differences across Mexico, Argentina, Colombia, Chile, Peru, and other Spanish-speaking countries.
• Experience evaluating user-generated content or digital communications.
• Interest in AI , language models, and internet culture research.
Application Process (Takes 20–30 mins to complete)
• Upload resume
• AI interview based on your resume
• Submit form
Resources & Support
• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.