18 hours ago
Responsibilities
- Design, develop, and operate large-scale, secure, low-latency ML serving systems for real-time and batch inference.
- Build distributed systems and hybrid online/offline serving patterns for scalable inference workloads.
- Optimize model inference through quantization, tensor parallelism, inference runtimes, and low-level GPU kernel development.
- Develop foundational ML platforms and tooling, including feature stores, vector databases, automation, abstractions, and reusable components.
- Define and refine architectures for scalable advertising and machine learning challenges.
- Provide technical leadership and mentorship through code reviews, design reviews, working groups, and internal knowledge sharing.
- Collaborate with engineers, data scientists, and technical and non-technical cross-functional teams.
Requirements
- Proven experience designing and operating large-scale, low-latency ML serving platforms supporting real-time and batch inference.
- Experience with model quantization, tensor parallelism, and inference optimization technologies such as ONNX Runtime, TensorRT, or vLLM.
- Experience with distributed systems such as Ray and high-throughput RPC systems for scalable inference workloads.
- Hands-on experience designing and optimizing low-level GPU kernels for hardware utilization, memory bandwidth, and deep learning performance.
- Experience in advertising, federated learning, and privacy-preserving machine learning techniques.
- Experience leading foundational AI/ML platforms and tooling, including feature stores and vector databases.
- Strong software engineering, performance tuning, troubleshooting, communication, and technical leadership skills.
- PhD, MS, or BS in computer science or a related field, with 6+ years of machine learning experience.
Categories
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.