Lead Data Engineer With Snowflake

Key Responsibilities

• Understanding the business requirements
• Writing code and implementing the proposed solutions
• Creating data pipelines, versioning and change management
• Manage the complexity inherent in versioned data pipelines
• Develop ETL/ELT processes to help extract and manipulate data from multiple sources
• Design, build and maintain batch or real-time data pipelines in production
• Automate data workflows such as data ingestion, aggregation, and ETL processing
• Logging and instrumentation of pipelines and services
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures
• Train and mentor junior engineers

Job Description: Data Engineer

NoSQL-to-RDBMS Mapping: Flatten and normalize complex, nested JSON data from MongoDB into structured relational tables.

Pipeline Development: Build and manage reliable ETL pipelines to ingest data from MongoDB, process it via Snowflake, and load it into MySQL.

Database Optimization: Design, index, and tune target MySQL databases to ensure high performance and strict data integrity.

Snowflake Utilization: Leverage Snowflake's variant handling capabilities to efficiently stage, parse, and transform semi-structured data.

Technical Stack: Proficiency in MongoDB, MySQL, Snowflake SQL, good to have Python (including ETL frameworks like rivery or informatica).

What is it like working for 3Pillar Global?

• Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach.
• You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday.
• We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing.
• Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.
• We are an equal opportunity employer. We live by values like Intrinsic Dignity and Open Collaboration.

Benefits

• Flexibility & Well-being – Our remote-first approach gives you the flexibility to work where you perform best, while prioritizing your well-being and personal commitments.
• Global Community – Collaborate with talented colleagues across the globe in a culture built on connection, support, and shared success.
• Your Voice Matters – We foster open communication and multiple feedback channels, ensuring every employee has the opportunity to be heard and make an impact.
• Growth & Development – Gain exposure to diverse clients, industries, and challenges.