Innodatainc
Data Platform Engineer (GCP)
datafull-timeRemote - Canada
SALARY
Not listed
WORK TYPE
remote
JOB TYPE
full-time
INDUSTRY
beginner
✦ AutoApply Let us apply to roles like this on your behalf.
Learn more
About the role
Scope of the Role
We are looking for a hands-on GCP / Data Platform Engineer to support, maintain, and enhance large-scale production data platforms running on Google Cloud. The role is focused on platform reliability, production support, troubleshooting, performance optimization, and continuous enhancement rather than greenfield platform development.
The ideal candidate can quickly understand a complex existing environment, diagnose issues across data pipelines and infrastructure, and implement practical improvements with minimal disruption. Experience operating large-scale, business-critical data platforms in complex enterprise environments is preferred.
What You'll Own
- Support and maintain production GCP data platforms, pipelines, and workflows across batch and streaming workloads.
- Support production workflows orchestrated through Cloud Composer / Apache Airflow, including troubleshooting DAG failures, dependencies, scheduling issues, retries, and data-latency or SLA issues.
- Optimize Airflow DAGs and orchestration workflows to improve reliability, execution time, recoverability, and operational efficiency.
- Troubleshoot pipeline failures, data latency, performance degradation, configuration problems, and infrastructure-related issues.
- Work extensively with Cloud Spanner, BigQuery, Dataflow, Pub/Sub, Cloud Composer (Apache Airflow), Cloud Storage, Cloud Monitoring and Logging, IAM, and related GCP services.
- Monitor platform health and proactively improve reliability, scalability, performance, and operational efficiency.
- Optimize existing pipelines and workloads to improve data refresh times, throughput, query performance, and platform stability.
- Support platform, infrastructure, configuration, and dependency upgrades while maintaining production stability and compliance.
- Perform root-cause analysis for recurring production issues and implement sustainable fixes.
- Support IAM, access controls, monitoring, alerting, logging, and operational governance.
- Collaborate with client and cross-functional Data Engineering, BI/Analytics, Application Engineering, Infrastructure, and Platform teams on production issues and enhancements.
- Adapt to established client-specific engineering, security, compliance, review, and operational processes.
- Review existing architectures and recommend incremental improvements without unnecessarily redesigning stable production systems.
- Create and maintain technical documentation, operational runbooks, troubleshooting guides, and platform support procedures.
You'll Thrive in This Role If You Have
- 3-7 years of experience in Data Engineering, Cloud Engineering, Platform Engineering, or a related role.
- Strong hands-on experience building, supporting, or maintaining production workloads on Google Cloud Platform (GCP).
- Strong experience with BigQuery and Cloud Spanner.
- Hands-on experience with Dataflow, Pub/Sub, batch/streaming data pipelines, and Cloud Composer / Apache Airflow.
- Strong Python and SQL skills.
- Good understanding of GCP
✦ Let us apply for you
We find roles like this and apply on your behalf. Cover letter written for each one. Plans from $15/mo. Cancel anytime.
Get AutoApply