Sr. Data Engineer

JOB SUMMARY

Senior Data Engineers spend most of their time hands-on in the creation, feature development, and subsequent maintenance of NeueHealth properties. The more senior their level, the more that individual will assist in the continuous improvement of the team's productivity and overall design of our systems. Additionally, senior talent plays a key role in building and maintaining a culture which focuses on making sure every engineer progresses in their career in line with personal goals/expectations.

Preferred locations for candidates are MN and TX.

DUTIES & RESPONSIBILITIES

• Write traditional code and server-less functions using the language best suited for the task, which is primarily Scala. May include development with C# and SQL.
• Build APIs, data microservices and ETL pipelines, to share data with internal and external partners and write interfaces to public data sets to enrich our analytics data stores.
• Develop and optimize processes for fine-tuning large language models (LLMs) and implementing Retrieval-Augmented Generation (RAG) frameworks to enhance AI-driven solutions.
• Participate in building and owning a culture of DevOps and Quality Assurance.
• Continuously document your code, framework standards, and team processes.
• Build and support Data Ingestion frameworks deployed in Azure.
• Other duties and responsibilities as assigned.

EDUCATION AND PROFESSIONAL EXPERIENCE

• Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, or equivalent experience required.
• Around Five (5) years of experience in an enterprise or commercial software development environment. Healthcare IT background is highly preferred.
• Enterprise development experience coding in Scala.
• Experience building batch and streaming data pipelines (Scala).
• Experience with API design.
• Extensive experience developing data-intensive solutions in a Cloud environment.
• Extensive experience developing solutions that use event sourcing and/or Big Data architectures.

Preferred Qualifications:

• Experience engineering big-data solutions using technologies like Databricks, Hive, and Spark.
• Experience with functional programming in Scala and C#
• Experience building distributed systems with microservices and/or service-oriented architectures
• Experience working within an Azure environment. Hands on Azure admin and DevOps experience is a plus.
• Familiarity with containerization/virtualization, e.g., Docker, Kubernetes
• Familiarity with Databricks infrastructure management