AI Data Quality Analyst (Human-in-the-Loop)

About the Role

We are looking for a hands-on AI Data Quality Analyst (Human-in-the-Loop) to support a strategic client in the commercial property insurance space. This role sits at the intersection of data quality, QA, and product thinking.

You will be the “human in the loop” for an AI-powered document processing pipeline: reviewing what the AI extracts from complex insurance submissions (e.g., Statements of Values (SOVs), loss runs, spreadsheets, PDFs), correcting errors, and ensuring that downstream tools receive clean, reliable data. On top of the day-to-day “grind work” of validation and correction, you’ll zoom out to identify recurring issues, spot patterns, and translate them into clear requirements and bug reports for the engineering team.

This is not a Product Manager role and not a “purely strategic” position. It is very hands-on, detail-oriented work that is critical to improving our AI systems and ultimately the client’s underwriting workflow.

What You’ll Do

• Review AI-extracted data from insurance submissions (SOVs, loss runs, supporting documents) for accuracy, completeness, and consistency.
• Compare extracted fields against source documents, identify discrepancies, and correct data directly in the appropriate systems or templates.
• Act as a quality gate for the AI pipeline, ensuring output meets agreed business and underwriting expectations before it moves downstream.
• Log issues, defects, and edge cases with clear reproduction steps, examples, and impact, using tools like Jira or similar.
• Identify patterns and root causes behind extraction errors (e.g., recurring issues with specific formats, document types, or fields).
• Translate observed patterns into well-structured requirements, user stories, and bug reports that engineering and data teams can act on.
• Collaborate closely with architects, data engineers, and other analysts to refine extraction rules, templates, and workflows.
• Use LLMs and AI assistants as tools (e.g., for summarization, cross-checking, hypothesis generation), while exercising sound judgment about what to trust and what to verify.
• Help continuously improve documentation, checklists, and guidelines for reviewing submissions and extractions.
• Over time, contribute to defining metrics and dashboards for data quality and model performance (e.g., accuracy by field, error rates by document type).
• Work primarily in Eastern European time zones with sufficient overlap to collaborate with US-based stakeholders.

What We’re Looking For

• 3+ years of experience in a data-intensive role such as data analyst, business analyst, QA analyst, operations analyst, or similar.
• Strong attention to detail and proven experience doing systematic, repetitive data review without loss of quality.
• Excellent analytical skills: ability to trace issues from symptoms (wrong numbers, missing fields) back to likely root causes (document patterns, parsing logic, business rules).
• Demonstrated ability to write clear, structured tickets/requirements for engineering teams (e.g., bug reports, user stories, acceptance criteria).
• Advanced Excel skills (pivot tables, lookups, filters, data cleansing techniques).