Founding ML Engineer in the Flower Frontier Model Team (all seniority levels welcome) [UK, Germany, Global]

About the Role

(Preference given to candidates with post-training expertise. But any talented individual with a track record of exceptional drive and determination are encouraged to apply regardless of prior experience.)

As a founding ML Engineer in this new team, you will play a critical role in building SOTA LLMs and foundation models within a small, high-impact team composed of contributors that have a mix of both research and engineering backgrounds. This role combines fast-paced development with disciplined software engineering: you will help build a reliable, maintainable and scalable software stack and use this to produce world-leading models that are open-sourced and integrated into new Flower Lab products.

You will design, implement and optimize core components across the full spectrum of stages relevant to frontier model building: data curation, evals, pre-training, post-training — everything is in scope as the team seeks to release its first series of models. Experience in these areas is obviously welcome, but a general expectation of problem solving, learning on the job and working collaboratively to efficiently combine the talents of the team is an explicit requirement for success. Familiarity with ML distributed and scaling strategies will be essential, as will experience working with GPU clusters (or similar) for multi-node training. You will diagnose and resolve GPU/kernel issues, memory/storage bottlenecks, and multi-node failures at scale — and collaborate on the debugging of training instabilities and related issues. Ability to adapt to different HPC configurations and GPU architectures (e.g., AMD/NVIDIA) will be a big plus. You will also devise surrounding infrastructure, tooling, monitoring, and observability, all essential for large-scale LLM development.

This is a foundational role for an ambitious technical effort. We are looking for a special talent that brings strong engineering discipline to the team, and has the ability to assume technical leadership as the training system scales in complexity and capability. More broadly, you can expect a collaborative, fast-paced and demanding start-up environment containing a team of experts in their respective fields, in which everyone still learns something new every day. You will have the opportunity to contribute ideas, be heard and influence the direction of the company across the board.

About the Company

Flower Labs is the world-class AI startup best known for being behind the most popular open-source framework in the world for training AI on distributed data and compute resources using decentralized and federated methods. Trusted by industry leaders such as Mozilla, JP Morgan, Owkin, Banking Circle and Temenos use Flower to easily improve their AI models on sensitive data that is distributed across organizational silos or user devices. In a world where most AI relies on centralized public datasets — just a fraction of the data available — we believe unlocking access to (orders of magnitude more) sensitive data will drive the next breakthroughs in artificial intelligence.