Generative Audio Evaluation

Accountabilities:

• • Evaluate AI-generated audio for short video and text-to-audio tasks according to detailed project guidelines.
  • Assess speech, background music, and sound effects for clarity, quality, naturalness, and overall audio performance.
  • Evaluate audio-video synchronization, including lip-sync accuracy, timing, and alignment between generated audio and visual content.
  • Verify that generated audio accurately follows provided captions, text instructions, and task-specific requirements.
  • Assess the naturalness and quality of generated voices and, when applicable, compare them against reference audio.
  • Assign accurate scores based on established evaluation criteria and consistently document identified issues.
  • Provide detailed and reliable feedback that can help identify model weaknesses and improve generative audio performance.
  • Complete required project evaluations and testing within established deadlines.

  Requirements:

  • Native-level fluency in Portuguese.
  • Strong attention to detail and excellent listening skills.
  • Good understanding of spoken language, audio quality, context, and natural-sounding speech.
  • Ability to follow detailed evaluation guidelines accurately and consistently.
  • Strong analytical skills and the ability to identify subtle differences or quality issues in generated audio.
  • Reliable equipment, including high-quality headphones suitable for detailed audio evaluation.
  • Ability to complete the required evaluation test within 48 hours of receiving the assignment.
  • Availability to work at least 10 hours per week on a flexible schedule.
  • Comfortable working independently in a remote freelance environment.
  • Successful completion of the required qualification process, including language assessments, onboarding, and project-specific testing such as TTS evaluation, audio evaluation, or transcription testing.
  • Applicants should select the vendor status that accurately reflects whether they operate as a freelancer/business or as a private individual.

  Benefits:

  • Fully remote position within Brazil.
  • Freelance work arrangement.
  • Part-time commitment of 10+ hours per week.
  • Flexible schedule — work whenever you want within the project requirements.
  • Compensation of US$6 per hour.
  • Opportunity to contribute to the development and improvement of generative AI technology.
  • Specialized experience in AI evaluation, audio quality assessment, and emerging generative technologies.
  • Equal-opportunity environment committed to diversity, equity, and inclusion.