Senior Software Code Reviewer
About the role
About Vetto
Vetto is a tech company focused on building and scaling high-quality datasets for artificial intelligence systems. We work at the intersection of human expertise and AI, ensuring that models are trained on technically accurate, well-defined, and realistic data.
Our projects support the training and evaluation of Large Language Models (LLMs), where technical rigor and correctness are non-negotiable.
About the Project
This project focuses on the technical review and validation of coding tasks used to train AI models. Automated code is generated in response to software engineering prompts, and your role is to evaluate whether that code is correct and truly solves what was asked.
The core questions you will be answering on every task:
- Is the coding task technically well-defined?
- Does the generated code actually solve the problem?
- Are the associated tests robust, correct, and aligned with real-world software behavior?
Tests are treated as the mechanism of truth in this context. Mistakes here propagate at scale into AI systems, error criticality is high.
Languages
Tasks in this project involve code written across multiple languages. You will be expected to review and evaluate tasks in any of the following: Python, JavaScript / TypeScript, Go, Rust, and Java.
Strong command of at least two of these languages is required. Breadth across languages is a plus.
Responsibilities
- Review and analyze generated code against the original software engineering prompt
- Evaluate whether the coding task itself is clearly and correctly defined
- Validate whether tests accurately reflect whether the problem has been solved
- Identify gaps, ambiguities, false positives, and false negatives in test suites
- Determine whether a solution that passes the tests genuinely solves the underlying problem
- Apply strict technical criteria and quality standards consistently across tasks
Required Profile
This role is designed for mid/senior-level software engineers with real pro