Apple

Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference

Apple
Apply
2 months ago
Paris, FranceSenior

Responsibilities

  • Lead complex, ambiguous machine learning projects end to end.
  • Bring foundation-model architectures from research prototypes to planetary-scale production deployment.
  • Own inference efficiency, hardware/software co-design, systems architecture, and tooling.
  • Build and optimize inference systems on Apple’s CloudOS and Private Cloud Compute infrastructure.
  • Partner with Foundation Model Research, external partners, platform teams, and security teams.
  • Build and operate high-throughput services at large distributed scale.
  • Help set technical direction for surrounding engineers.

Requirements

  • Proficiency in PyTorch or JAX.
  • Experience working with inference frameworks.
  • Experience with Python, Rust, Go, or similar programming languages.
  • Proficiency deploying applications on cloud platforms such as AWS or GCP using Kubernetes and Docker.
  • Experience leading complex, ambiguous machine learning projects end to end.
  • Hands-on experience with LLM inference stacks is preferred.
  • Working knowledge of GPU or TPU programming concepts is preferred.
  • Experience building production systems in Go or Python is preferred.
  • Strong knowledge of deep learning architectures, including Transformers, encoder/decoder models, and multimodal variants, is preferred.
  • Experience with TensorRT-LLM, vLLM, SGLang, TGI, or Nvidia Triton Server is preferred.
  • An MS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field is preferred.
Apple

About Apple

10,000+ employees

Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.

Contact me