Portuguese AI Evaluation Specialist (Brazil)
This is a referral link. If you join through it, RemoteStack may earn a referral bonus.
About the role
Pay: Up to $25/hour
Opportunity Overview
Handshake is looking for Portuguese speakers based in Brazil to help make AI responses more personalized. This is not a traditional job — you'll use your Portuguese language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users.
This is an ongoing, project-based opportunity you can take on alongside your current role.
What You'll Do
Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
Provide clear written feedback that helps AI better understand and personalize responses for individual users
Complete tasks at your own pace with no set schedule or minimum hour requirement
Qualifications
Ideal candidates meet all of the following:
Location — Based in Brazil and able to work remotely in an asynchronous, self-directed capacity
Language — Fluent in Portuguese, both written and spoken, with strong written communication skills for explaining your reasoning clearly. A minimum of B2-level English proficiency is also required, as all platform content, instructions, and training materials are provided in English.
Judgment — Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
Required for all applicants
Must have a Bachelor's degree or higher
Strong written communication in Portuguese and English at B-2 level proficiency
Ability to work independently in a remote, asynchronous environment