Castilian Spanish Labeler / Annotator

About the Role

We're looking for a Castilian Spanish Labeler / Annotator to evaluate responses generated by AI systems. In this role, you'll perform side-by-side evaluations of outputs from different AI models across a variety of real-world scenarios. Your analysis will help improve how AI systems understand and communicate in Castilian Spanish.

This is not a translation role. It is an evaluation and analysis role that requires strong judgment, cultural awareness, and careful attention to detail.

What You'll Do

• Perform side-by-side comparisons of AI-generated responses.
• Evaluate outputs for accuracy, relevance, clarity, instruction-following, and overall quality.
• Assess AI responses across general-purpose questions and answers, web search results, file-based and image-based responses, content-generation tasks, and single-turn and multi-turn conversations.
• Identify nuances in language, tone, meaning, and cultural context specific to Castilian Spanish.
• Apply detailed, scenario-specific annotation guidelines accurately and consistently.
• Document evaluation decisions clearly and provide rationale when required.
• Maintain consistent quality and judgment across a high volume of evaluations.
• Participate in training, calibration, and ongoing quality-review activities.

What You'll Bring

• Native-level or professional fluency in Castilian Spanish.