8 hours ago
Responsibilities
- Define the technical vision and strategy for the foundation model inference engine and related systems.
- Drive execution across teams and lead engineers in delivering technical milestones.
- Improve inference performance, efficiency, reliability, throughput, latency, cost, and quality at scale.
- Partner with ML researchers and modeling teams to productionize research and integrate capabilities into the model development loop.
- Contribute to adjacent systems areas including training infrastructure, data systems, evaluation, and reinforcement-learning loops.
- Mentor junior and senior engineers and establish a high bar for engineering excellence.
Requirements
- MS or PhD in Computer Science, Machine Learning, or a related technical field, or equivalent industry experience.
- 15+ years of experience building large-scale ML or distributed systems with company-wide or industry-wide technical impact.
- Deep hands-on expertise building foundation model inference engines and improving their performance, efficiency, and reliability at scale.
- Experience supporting diverse foundation model inference use cases with different throughput, latency, cost, and quality requirements.
- Strong understanding of GPU, TPU, and accelerator architecture, distributed systems, and model optimization techniques such as quantization, distillation, compilation, and serving.
- Proficiency with ML frameworks such as JAX and PyTorch and with inference and serving stacks.
- Experience leading diverse engineering teams in setting vision, prioritizing work, and driving milestone execution.
- Experience mentoring junior and senior engineers and partnering with ML researchers to productionize research.
- Preferred experience with large language model and multimodal foundation model inference, inference in training or evaluation loops, Kubernetes, Docker, cloud platforms, and distributed computing frameworks.
Categories
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.