AI Response Labeler / Annotator – Castilian Spanish Specialty

About Blueprint

Blueprint is a technology solutions firm headquartered in Bellevue, Washington, with teams across the United States. We help organizations turn complex challenges into meaningful outcomes by connecting strategy and execution across AI, cloud, data, product development, and emerging technology.

Our culture is built by people who care deeply about doing exceptional work. We set high standards, take ownership, and continually challenge ourselves and one another to be better. We work hard, support each other, and take genuine pride in what we deliver for our clients, partners, and teams.

At Blueprint, you’ll work alongside talented people with different experiences, expertise, and perspectives. You’ll have opportunities to take on meaningful challenges, expand your skills, and see the impact of what you build.

Bring your perspective. Raise the standard. Build what matters.

About the Role

We’re looking for an AI Response Labeler / Annotator with deep expertise in Castilian Spanish and the cultural context of Spain.

This is an AI annotation and evaluation role, not a translation or traditional localization position. Castilian Spanish expertise is an essential specialization, but it represents only one component of the work. You’ll evaluate AI-generated responses across a broad range of topics, tasks, and real-world scenarios. Much of the content, annotation guidance, and day-to-day work will be in English.

You’ll perform side-by-side comparisons of responses generated by different AI models and determine which response better meets the user’s needs. This requires strong analytical judgment, the ability to interpret detailed guidelines, and the consistency to apply those standards across a high volume of evaluations.

Successful candidates will be comfortable assessing content beyond language quality alone. You may be asked to evaluate factual accuracy, relevance, completeness, reasoning, instruction-following, clarity, safety, tone, and overall usefulness.

What You'll Do

• Perform side-by-side comparisons of AI-generated responses and determine which response is stronger.
• Evaluate responses for factual accuracy, relevance, completeness, clarity, reasoning, instruction-following, tone, and overall quality.
• Assess content written in English, Castilian Spanish, or a combination of both, depending on the assigned scenario.
• Evaluate a broad range of content, including general-purpose questions and answers, web-search results, file-based tasks, image-based responses, content-gener