Lead Software Engineer, Content Ingestion

What You'll do:

• Design, build, and evolve high-throughput data pipelines that ingest and transform large volumes of unstructured content into structured and enriched datasets
• Drive technical direction and architectural decisions across ingestion systems, ensuring scalability, reliability, and long-term maintainability
• Improve data quality, correctness, and enrichment workflows to support downstream systems such as Search and Data Science
• Build and operate distributed, event-driven systems and streaming pipelines with strong observability and fault tolerance
• Partner cross-functionally with Product, Data Science, Search, and Platform teams to deliver high-quality data that powers customer-facing features
• Mentor and support engineers through code reviews, technical guidance, and knowledge sharing, raising the overall engineering bar
• Identify and lead high-impact technical initiatives, balancing speed of delivery with system stability and long-term health

To be set up for success in this role, you'll need to have:

• 8+ years of professional experience as a software engineer
• Experience designing, building, and operating distributed systems, data pipelines, or event-driven architectures at scale
• Strong proficiency in Python or a similar backend programming language
• Experience building and maintaining microservices that are reliable, observable, and scalable
• Experience working with streaming technologies such as Kafka, Kinesis, or similar systems
• Experience with APIs and service communication patterns such as gRPC and Protocol Buffers
• Experience working with large-scale data systems or high-throughput SaaS platforms
• Expertise with relational or search databases such as MySQL, Postgres, Elasticsearch, or OpenSearch
• Experience making technical tradeoffs in distributed systems related to performance, reliability, and maintainability

If any of the below also describe you, this could be an exciting opportunity:

• Experience designing or optimizing content ingestion, ETL/ELT, or data enrichment pipelines
• Experience improving throughput, reliability, and observability in large-scale data systems
• Experience with background job processing frameworks and asynchronous workflows
• Experience working on systems that process large volumes of unstructured content