Internet-Native Bilingual Evaluator Expert (French)

Mercor is seeking Internet-Native Bilingual Evaluator Experts (French–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use. This role is ideal for individuals who actively participate in both French- and English-language online communities and understand how internet culture, slang, humour, and social norms differ across languages.

Analyse content from French- and English-speaking online communities.

Job Responsibilities

Evaluate Internet-Native Communication

Develop Evaluation Standards

Conduct Model Testing and Feedback

Support Quality Assurance

Minimum Qualifications

Preferred Qualifications

Mercor is seeking Internet-Native Bilingual Evaluator Experts (French–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use. This role is ideal for individuals who actively participate in both French- and English-language online communities and understand how internet culture, slang, humour, and social norms differ across languages. Analyse content from French- and English-speaking online communities. Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity. Identify errors involving slang, memes, cultural references, sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication. Define expectations for culturally appropriate and platform-native language. Document linguistic and cultural edge cases. Test language models using real-world bilingual prompts. Evaluate outputs in English and French. Provide detailed feedback to improve performance. Participate in QA reviews and benchmark creation. Ensure consistency across evaluators and datasets. Native or near-native fluency in French and professional fluency in English. Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions. Active participation in internet culture across both languages. Strong writing, analytical, and critical thinking skills. Available to commit 10–20 hours per week. Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation. Familiarity with differences between European French, Québec French, and other French varieties. Experience evaluating online content and internet-native communication. Interest in AI and multilingual language technologies. We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

• Analyse content from French- and English-speaking online communities.
• Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity.
• Identify errors involving slang, memes, cultural references, sarcasm, and code-switching.
• Build evaluation rubrics for bilingual internet communication.
• Define expectations for culturally appropriate and platform-native language.
• Document linguistic and cultural edge cases.
• Test language models using real-world bilingual prompts.
• Evaluate outputs in English and French.
• Provide detailed feedback to improve performance.
• Participate in QA reviews and benchmark creation.
• Ensure consistency across evaluators and datasets.
• Native or near-native fluency in French and professional fluency in English.
• Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions.
• Active participation in internet culture across both languages.
• Strong writing, analytical, and critical thinking skills.
• Available to commit 10–20 hours per week.
• Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation.
• Familiarity with differences between European French, Québec French, and other French varieties.
• Experience evaluating online content and internet-native communication.
• Interest in AI and multilingual language technologies.