AIML - Staff ML Infrastructure Engineer, ML Platform & Technology - Pre-training Infrastructure
Apple2 months ago
Responsibilities
- Drive performance optimization for large-scale foundation model training on TPUs.
- Profile and optimize JAX/XLA workloads across compute, memory, communication, and compilation.
- Develop high-performance TPU kernels for operations including attention and Mixture-of-Experts.
- Optimize distributed training, sharding strategies, and collective communication over TPU interconnects.
- Research and implement improvements across the JAX, XLA, and TPU stack.
- Develop profiling, benchmarking, and automated tuning capabilities for large-scale training workloads.
- Collaborate with cross-functional engineers on large-scale ML training challenges.
- Lead complex technical projects and mentor engineers.
- Cultivate a collaborative team focused on technical excellence and innovation.
Requirements
- 6+ years of experience building or optimizing high-performance ML or distributed systems.
- Proficiency in Python or other relevant programming languages.
- Strong understanding of distributed systems, parallel computing, and performance optimization.
- Experience profiling and optimizing compute-, memory-, or communication-intensive workloads.
- Ability to communicate complex technical problems clearly and collaborate with partners.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Preferred: advanced degree in Computer Science, Engineering, or a related field.
- Preferred: experience with TPU or GPU accelerators and accelerator architecture and performance characteristics.
- Preferred: experience with JAX, XLA, PyTorch, or other ML compiler/runtime stacks.
- Preferred: experience optimizing accelerator kernels with Pallas, Triton, CUDA, or similar technologies.
- Preferred: experience optimizing large-scale foundation model training and distributed communication.
Categories
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.