Staff Software Engineer - Core Ingest
About the role
Staff Software Engineer - Core Ingest
The proliferation of machine log data has the potential to give organizations unprecedented real-time visibility into their infrastructure and operations. With this opportunity comes tremendous technical challenges around ingesting, managing, and understanding high-volume streams of heterogeneous data.
As a Staff Software Engineer - Core Ingest, you will actively contribute and lead engineers in the design and development of new distributed data processing capabilities. You will be instrumental in helping us solve complex, low-latency, distributed systems challenges to handle our ever-increasing scale. Our system is a highly distributed, fault-tolerant, multi-tenant platform that includes bleeding-edge components related to storage, messaging, search, and analytics. This system ingests and analyzes petabytes of data a day, while making exabytes of data available for search and forensic analysis.
You are a strong software engineer who is passionate about large-scale systems. You care about producing clean, elegant, maintainable, robust, well-tested code; you do this as a member of a team, helping the group come up with a better solution than you would as individuals. Ideally, you have experience with performance, scalability, and reliability issues of 24x7 commercial services.
Responsibilities
- Designing and implementing extremely high-volume, fault-tolerant systems