Senior Backend Engineer, AI Engineering: Chat
About the role
An overview of this role
As a Senior Backend Engineer on the Duo Chat team, focused on Chat Engine, you'll build the core AI capabilities behind GitLab Duo Chat, the natural-language and agentic interface to the GitLab DevSecOps platform. Much of your work will involve building flow components and agentic flows in the Flow Registry, the Python framework built on LangGraph within our Duo Workflow Service that powers agentic chat, and integrating them with the GitLab Rails monolith.
You'll own complex backend features from start to finish across both services. You'll integrate large language models and orchestrate multi-agent flows so customers can work faster and more securely across the software development lifecycle. This work sits where GitLab's core platform meets its AI strategy, and reliability, performance, and answer quality directly shape the customer experience.
What you'll do
- Design and build flow components and agentic flows in the Flow Registry using Python and LangGraph within the Duo Workflow Service. These reusable building blocks power agentic Duo Chat and, increasingly, other AI features across GitLab.
- Develop, ship, and maintain backend features for GitLab Duo Chat across the Python Duo Workflow Service and the GitLab Rails monolith in a secure, well-tested, and performant way.
- Integrate new generative AI models, providers, tools, and multi-agent orchestration patterns into Duo Chat to expand its capabilities and improve answer quality.
- Design, implement, and review GraphQL and REST APIs and related monolith logic, including chat entry points, permissions, and foundational-flow registration. Keep contracts with frontend clients and host systems reliable and clear.
- Improve debugging, observability, and test coverage using pytest, RSpec, and related frameworks; track and improve latency, error rates, and test coverage so AI-powered chat workflows stay reliable at scale.
- Collaborate with Product, UX, frontend, and AI specialists to refine requirements and deliver high-quality improvements through iteration.
- Document standards, patterns, and learnings with other engineers, raising the bar for safe AI integration and evidence-driven engineering.
- Participate in Tier 2 on-call rotations to troubleshoot production issues, contribute to root cause analysis, and strengthen resiliency.