Senior Backend Engineer (AI & Data Pipelines) [Contractor]

Role Summary

We are looking for a Senior Engineer with a strong background in both Backend and Data Engineering to play a key role in building our next-generation data platform. In this role, you will partner closely with our Lead Data Architect to map existing data sources, perform gap analyses, and design the pipelines and integrations that feed our Knowledge Graph. You will have a direct impact on architecting modern cloud data pipelines (focused on Microsoft Fabric or equivalent environments) and designing the workflows that connect our data to LLM-enrichment pipelines. This is an opportunity for an engineer who enjoys solving complex integration challenges and working at the intersection of structured data, APIs, and AI workflows.

Key Responsibilities:

• Inventory existing data sources (APIs, schemas, quality, schema markup);
• Run gap analysis between current systems and the target Knowledge Graph model;
• Support System Architecture design with integration and data-flow input;
• Design ETL/ELT pipelines into the target lakehouse/data lake (e.g., OneLake), using tools such as Fabric Data Factory and Dataflows Gen2, or equivalent;
• Design the LLM enrichment pipeline and human-review workflow;
• Document API contracts, source-to-target mappings, and pipeline sequencing for Build.

Required Qualifications:

• Solid background in backend engineering, with proven experience in data engineering;
• Strong C# / .NET and/or Python (PySpark a plus);
• Hands-on experience with modern cloud data engineering platforms and tools (e.g., Microsoft Fabric — Data Factory, Dataflows Gen2, Lakehouse, OneLake, Notebooks — or equivalent services on Azure, AWS, or GCP);
• Solid experience with cloud platform services (e.g., Azure Functions, SQL, Service Bus/Event Grid, Key Vault, or equivalents on other cloud providers);
• REST APIs, GraphQL, webhooks, and event-driven integration patterns;
• Experience integrating with SaaS platforms (PIM / eCommerce preferred);
• Familiarity with Azure OpenAI or LLM-based pipelines;
• SQL strong; graph query languages (GQL, Cypher, SPARQL) a plus.

Nice to have:

• Microsoft Fabric IQ (preview) experience;
• Schema.org / JSON-LD familiarity;
• CPG, retail, or eCommerce integration background;
• Microsoft certifications: Azure or Fabric Data Engineer Associate.

REMOTE WORK: This position is remote-friendly. Just a reminder: remote employees must live in Brazil.