Senior Software Engineer, AI
About the role
About Syllo
Syllo is on a mission to transform litigation. Our product is an AI-powered litigation workspace that enables lawyers and paralegals to safely harness the power of language models throughout the litigation life cycle. Since going to market, we have gained a diverse group of enterprise customers, including some of the biggest law firms in the country, and we are quickly expanding. By reducing the expense of litigation industry-wide, we aim to improve access to high-quality representation and promote the alignment of legal outcomes with merit.
We are a mission-driven venture and recognize the enormous societal benefits that will result from a legal system that works better for everyone.
We are seeking a skilled and fast-moving Senior AI Engineer to join our team. This role is focused on the practical application of AI, specifically leveraging Large Language Models (LLMs), to build robust, scalable, and impactful user-facing features. This is an engineering-centric role—you will be an expert at building and integrating production systems, not primarily a research scientist.
The Responsibilities
- System Design & Implementation: Design and build high-performance, production-level AI-powered features and services, with a focus on reliability and scalability.
- Mitigating LLM Unreliability: Develop robust engineering solutions to mitigate the inherent unreliability of LLMs. This includes implementing effective guardrails, validation pipelines, error handling, caching, and failover/fallback mechanisms to ensure a high-quality user experience even when the model misbehaves.
- Optimization: Focus on optimizing latency, throughput, and cost efficiency.