AI Response Rater - Linguistic & Cultural Evaluation

Innodata (NASDAQ : INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.

By combining advanced machine learning and artificial intelligence (ML / AI) technologies, a global workforce of subject matter experts, and a high-security infrastructure, we’re helping usher in the promise of AI. Innodata offers a powerful combination of both digital data solutions and easy-to-use, high-quality platforms.

Our global workforce includes over 5,000 employees in the United States, Canada, United Kingdom, the Philippines, India, Sri Lanka, Israel and Germany.

About the Role :

We are seeking highly skilled and detail-oriented Raters to evaluate AI-generated responses in their assigned language and locale. Raters will play a crucial role in ensuring that AI systems produce accurate, culturally relevant, and contextually sensitive outputs.

Job title : AI Response Rater – Linguistic & Cultural Evaluation

Hourly Commitment : 5-6 hours per day

Ready to start from first week of September

Key Responsibilities :

• Evaluate two AI-generated responses to prompts in the assigned language / locale.
• Assess each response based on the provided rubric, focusing on :
• Linguistic Acceptability – grammatical accuracy, fluency, and naturalness.
• Local Adaptation – appropriateness of language use, idioms, and context.
• Cultural Sensitivity – awareness and respect for cultural norms and values.
• Determine which response is overall better and provide a clear written justification for your choice.
• Follow evaluation guidelines consistently to ensure high-quality and unbiased assessments.

Requirements :