Senior Software Engineer - Clickpipes (CDC/Streaming)

Note: We are hiring for this role remotely in any country ClickHouse has a hiring presence.

About the Team

The ClickPipes - Database Integrations team builds the platform that enables real-time data replication from databases into ClickHouse at petabyte scale.

As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open — our database integrations are built on PeerDB, an open-source CDC platform we actively maintain and contribute to.

See some of our recent work:

• Postgres CDC now supports failover replication slots
• MySQL CDC to ClickHouse with Native JSON Support
• Under the Hood: Building MySQL Change Data Capture in ClickPipes

What You’ll Do:

• Build data-intensive systems

  • Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake).
  • Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc.
  • Design integration solutions to enable users to fully harness ClickHouse's performance and throughput.

  Own end-to-end reliability

  • Debug complex issues in production leveraging runtime diagnostics (e.g. pprof, parca) and observability tools (e.g. metrics, logging, tracing).
  • Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations.
  • Write clear documentation, both publicly and internally.
  • Participate in on-call rotation.

  Drive product innovation

  • Work directly with customers to understand integration requirements and discover gaps in existing product.
  • Collaborate cross-functionally with internal teams to ensure operational efficiency.
  • Lead technical discussions and influence product roadmaps.

About You:

• 5+ years of industry experience building data-intensive software solutions.
• Proficient in Go, or experienced in systems programming with willingness to ramp up quickly in Go.
• Cloud-native experience deploying and operating services on at least one major cloud platform (AWS/GCP/Azure).
• Practical experience with Kubernetes.
• Strong problem solver and solid production debugging skills.
• Clear communication in writing (design docs, code review) and verbal.