Data Engineering Tech Lead-Azure

Responsibilities

• Provide leadership and guidance to the data engineering team, including mentoring, coaching, and fostering a collaborative work environment
• Set clear goals, assign tasks, and manage resources to ensure successful project delivery
• Work closely with developers to support them and improve data engineering processes
• Support team members with troubleshooting and resolving complex technical issues and challenges
• Utilize and promote Generative AI tools to accelerate project delivery
• Provide technical expertise and direction in data engineering, guiding the team in selecting appropriate tools, technologies, and methodologies
• Stay updated with the latest advancements in data engineering and ensure the team follows best practices and industry standards
• Collaborate with stakeholders to understand project requirements, define scope, and create project plans
• Support project managers to ensure projects are executed effectively, meeting timelines, budgets, and quality standards
• Monitor progress, identify risks, and implement mitigation strategies
• Act as a trusted advisor for the customer
• Oversee the design and architecture of data solutions, collaborating with data architects and other stakeholders
• Ensure data solutions are scalable, efficient, and aligned with business requirements
• Align coding standards and conduct code reviews to ensure proper code quality
• Identify and introduce quality assurance processes for data pipelines and workflows
• Optimize data processing and storage for performance, efficiency and cost savings
• Evaluate and implement new technologies to improve data engineering processes
• Act as main point of contact to other teams and contributors engaged in the project
• Maintain technical documentation of the project and perform regular reviews
• Ensure compliance with security standards and regulations

Requirements

• Bachelor's or master's degree in computer science, Information Systems, or a related field
• Minimum of 8-10 years of experience in data engineering or a related field
• Strong technical skills in data engineering, including proficiency in programming languages such as Python, SQL, R or Scala
• Practical experience with Microsoft Azure cloud and Databricks platform
• Familiarity with other cloud platforms, such as GCP or AWS, is beneficial
• Expertise in working with various data tools and technologies, such as ETL frameworks, data pipelines, and data warehousing solutions
• Proven experience in leading and managing a team of data engineers, providing guidance, mentorship, and technical support
• In-depth knowledge of data management principles
• Additional certifications in data integration tools or platforms are advantageous