Research Engineer (LLM Performance), London
Isomorphic Labs17 hours ago
London, United KingdomSenior
Responsibilities
- Implement and optimize LLM post-training methods at scale on frontier models.
- Translate new research methods into production-ready systems with research teams.
- Prioritize and execute model and systems performance optimizations.
- Evaluate and deploy frameworks for supervised fine-tuning, reinforcement learning, and LLM evaluation.
- Diagnose and fix performance bottlenecks and communication overhead in distributed training and inference systems.
- Deploy low-precision methods to balance performance and accuracy for drug design programs.
Requirements
- Significant experience with large-scale distributed training of LLMs.
- Experience with deep-learning ML frameworks such as JAX or PyTorch.
- Knowledge of parallelism strategies and collective communication libraries such as NCCL.
- Good understanding of GPU architectures and performance concepts.
- Experience with general LLM serving stacks is preferred.
- Knowledge of XLA, Triton, Pallas, CUDA, or similar accelerator DSLs or compilers is preferred.
- Experience optimizing ML accuracy using low-precision formats is preferred.
- Prior experience building, deploying, and maintaining production systems on GCP is preferred.
- Interest in chemistry and biology is preferred.
- Excellent collaboration skills.
Benefits
- Hybrid working requires attending the office three days per week, currently Tuesday, Wednesday, and one other team-dependent day.
- Accommodation discussions are available for applicants unable to follow the standard hybrid approach.
Tech Stack
Categories
AI ResearchML Engineering
About Isomorphic Labs
Isomorphic Labs develops AI models and a computational drug design platform for pharmaceutical R&D, working primarily through discovery collaborations and licensing. Founded in 2021 by Alphabet and headquartered in London, the company builds on advances such as AlphaFold to predict and design novel molecules. It has announced multi-year partnerships with Eli Lilly and Novartis to apply its technology to new therapeutics.