Senior ML Infrastructure Engineer
Ellison Institute of Technology1 day ago
Oxford, United KingdomSenior
Responsibilities
- Build, operate, and continuously optimize high-performance GPU training and inference clusters with highly available scheduling, isolation, and automated lifecycle management.
- Design and implement high-throughput data paths across compute and storage, including the current Lustre implementation.
- Benchmark, profile, and resolve performance bottlenecks across compute, networking, and orchestration layers.
- Establish observability, resilience, and automated security controls for sensitive research environments.
- Partner with Research, Data, and Applied teams on GPU and storage capacity planning, cost forecasting, quotas, and ML experimentation pipelines.
Requirements
- Proven experience leading the design, build, and operation of high-performance ML compute clusters at scale.
- Proactive and autonomous approach to systems design, with experience ideating, collaborating on, and implementing effective solutions.
- Experience migrating or transforming ML infrastructure from traditional schedulers to modern containerized systems.
- Expertise with high-throughput storage systems for ML and HPC workloads.
- Expert-level understanding of GPU architecture, high-speed networking for distributed training, and performance profiling.
- Solid understanding of infrastructure as code and CI/CD practices, including Terraform and Argo CD.
Benefits
- Competitive salary dependent on experience, travel allowance, and bonus.
- 25 days of annual leave plus 8 bank holidays and 3 additional days between Christmas and New Year, with the option to purchase 5 additional days in January and July.
- Employer pension contribution of 7.5% with a minimum employee contribution of 5%.
- Life assurance, income protection, private medical insurance, and a hospital cash plan.
- Employee discounts, electric car scheme, nursery salary sacrifice scheme, and Cycle to Work Scheme.
- Family planning support, neurodiversity support including advice and assessments, and coaching and therapy services.
- Hybrid Oxford work arrangement requiring onsite attendance at least 3 days per working week; candidates must live within commuting distance or relocate and be willing to travel as necessary.
Tech Stack
Argo CDTerraform
Categories
About Ellison Institute of Technology
Ellison Institute of Technology is a privately held research institute headquartered in Oxford, founded in 2023, focused on AI, robotics, health and generative biology, climate/CO2 management, and sustainable agriculture. It runs research programs and labs to translate discoveries into products and spinout companies, working across science, engineering, and policy. Its Oxford campus includes a 300,000 sq ft facility slated for 2027 and a planned 2 million sq ft expansion at The Oxford Science Park, designed by Foster + Partners.