Senior Software Engineer, AI

Engineering at Lattice

Lattice's Engineering team is continuously improving both our product and our craft. We build maintainable, performant systems using modern technologies, and we collaborate closely with product and design to deliver exceptional user experiences.

Our AI Engineering team is building the systems that power how AI works across Lattice. We've laid the foundations: traces are flowing and evals are running - and we're now focused on defining how our AI products are measured, improved, and trusted at scale. This is a high-ownership role where you'll help shape evaluation methodology, agent architecture, and the core systems that determine how AI performs in production.

What You Will Do

Evaluation Infrastructure

• Design and ship a robust, end-to-end AI evaluation framework, covering offline evals, production tracing, and human-in-the-loop feedback loops, connected across all of Lattice's AI use cases.
• Define and instrument the metrics that actually matter: agent task completion, hallucination rates, response quality, user engagement, and downstream business outcomes.
• Build and maintain evaluation datasets, test harnesses, and automated scoring pipelines to catch regressions before they ship.
• Identify and surface the drivers of agent quality improvement, giving the team clear signals on where to invest.