Jobgether
Jobgether

LLM Systems / AI Agent Engineer

engineeringfull-timeIndia
SALARY
Not listed
WORK TYPE
remote
JOB TYPE
full-time
INDUSTRY
general
Apply for this position
✦ AutoApply Let us apply to roles like this on your behalf.
Learn more

About the role

Accountabilities:

    • Build, deploy, and continuously improve production AI agents using foundation models, including AWS Bedrock and comparable providers.
    • Design and evolve orchestration systems supporting tool calling, streaming, context management, structured outputs, and agent workflows.
    • Apply context-engineering techniques to improve the reliability, quality, and effectiveness of LLM and agent systems.
    • Develop and maintain evaluation datasets and pipelines covering tool selection, agent trajectories, and LLM-as-judge evaluations.
    • Establish production observability, monitoring, tracing, and instrumentation for LLM and agent workloads.
    • Contribute architectural expertise to evaluate the existing custom orchestration layer and determine whether a production framework such as LangGraph or LangChain would provide additional value.
    • Work closely with the AI function lead and Full Stack Engineer as part of a focused three-person product team.
    • Operate as an individual contributor, taking ownership of clearly defined and measurable deliverables from onboarding onward.
    • Identify production failure modes, implement appropriate mitigations, and contribute across the AI engineering stack.
    • Optimize LLM operating costs through prompt caching, model selection, routing strategies, and broader LLM FinOps practices.
    • Help establish robust engineering practices for reliable, scalable, and maintainable agentic AI systems.
    • Requirements:

      • 2+ years of professional experience building production LLM agents, including tool-calling loops, streaming, context management, structured outputs, and orchestration.
      • Production experience with an agentic framework such as LangGraph, LangChain, or a custom orchestration solution, combined with strong understanding of agent architecture patterns.
      • 1.5+ years of experience with evaluation-driven development, including evaluation datasets and pipelines for tool selection, trajectory assessment, and LLM-as-judge approaches.
      • 1+ year of hands-on experience with LLM observability, tracing, and instrumentation using tools such as Langfuse, OpenTelemetry, or equivalent platforms; direct production experience with agent observability is particularly valuable.
      • 1+ year of experience optimizing LLM costs through prompt caching, model selection and routing, and LLM FinOps.
      • 5+ years of backend engineering experience, including strong proficiency with TypeScript/Node.js, PostgreSQL, and serverless AWS technologies.
      • Proven track record of shipping agentic AI systems to production and delivering comparable engineering projects against defined timelines.
      • Ability to discuss real-world agent failure modes, reliability challenges, and mitigation strategies with strong technical depth.
      • Ability to operate independently across the AI stack while collaborating effectively within a small, specialized engineering team.
      • Experience with AWS Bedrock is an advantage, while production experience with other foundation-model providers such as OpenAI, Anthropic, Azure OpenAI, or Vertex AI is transferable.
      • Knowledge of AI safety and guardrails, including prompt-injection protection, output validation, and handling untrusted inputs, is a plus.
      • Familiarity with MCP and multi-agent architectures is beneficial.
      • Exposure to geospatial data is an additional advantage.
      • Benefits:

        • Fully remote, full-time working arrangement in India.
        • Fixed working hours: 12:00 PM–9:30 PM IST during summer and 1:00 PM–10:30 PM IST during winter.
        • No weekend work, supporting a strong work-life balance.
        • Laptop provided from day one.
        • Full medical insurance from the start of employment.
        • Access to mentorship, professional communities, and knowledge-sharing forums.
        • Supportive, collaborative environment focused on continuous learning and professional development.
        • Opportunity to take meaningful ownership within a small, specialized AI product team.
        • Long-term career opportunity where individual contributions and technical impact are valued.
✦ Let us apply for you
We find roles like this and apply on your behalf. Cover letter written for each one. Plans from $15/mo. Cancel anytime.
Get AutoApply
Apply now