Machine Learning Enginer, Core Evaluations

About Cantina

Cantina Labs is a social AI company developing advanced real-time models for expression, personality, and realism. We build and power ecosystems that transform how people tell stories, connect, and create.

About the Role

We are seeking an experienced Machine Learning Engineer to focus on audio model evaluation, specifically for speech generation and recognition models. This role involves designing and developing comprehensive model evaluation pipelines for both development and production environments, as well as creating automated dashboards for reporting evaluation results. As the founding member of our evaluation team, you will leverage your experience to lead our evaluation efforts and play a key role in the future growth of the evaluation team.

What You'll Do

• Design model evaluation pipelines for models in development and production
• Design user studies for subjective model evaluations
• Convert requirements into measurable metrics
• Design and develop automated evaluation dashboards to see model performances and compare results
• Train new models to capture new and different evaluation metrics
• Communicate with the model team to help design better models