Apple

Senior Machine Learning Engineer, Conversational AI - Services Special Projects

Apple
Apply
23 hours ago
Cupertino, CA, USASenior
H1B sponsor

Responsibilities

  • Own the conversational intelligence layer, including agent reasoning, planning, tool calling, and low-latency LLM inference.
  • Design multi-turn conversational experiences and build intent, slot, clarification, and disambiguation capabilities.
  • Build and optimize production LLM and ML serving systems using inference optimization, caching, profiling, and model compression techniques.
  • Deploy and serve LLMs or ML models directly in production request paths.
  • Build and scale knowledge graph, lookup, retrieval, and real-time data services to keep responses accurate and grounded.
  • Develop automated and LLM-as-judge evaluations for multi-turn conversations and integrate them into development workflows.
  • Implement personalization, memory, privacy protections, and safety guardrails for LLM-powered agents.
  • Architect and lead projects with cross-functional stakeholders across Apple.

Requirements

  • Master's degree in Computer Science, Machine Learning, NLP, or a related field; a Ph.D. is preferred.
  • At least 7 years of experience as a software or machine learning engineer, with significant focus on conversational AI, search, or LLM-powered systems.
  • Strong programming skills in Go and Python, plus at least one of Java or Scala.
  • Hands-on experience shipping conversational AI or dialogue systems, including intent and slot understanding, multi-turn context, clarification, and disambiguation.
  • Production experience building LLM-powered applications with prompt design, tool or function calling, structured output generation, and agentic orchestration.
  • Experience optimizing LLM inference through distillation, quantization, batching, KV-cache tuning, caching, and profiling.
  • Experience deploying production-path LLM or ML serving systems with frameworks such as vLLM, SGLang, Triton, or TorchServe.
  • Experience with knowledge graphs, low-latency lookup and retrieval services, and preferably graph schemas, ingestion pipelines, or graph databases.
  • Fluency with PyTorch and the Hugging Face ecosystem, including transformers and PEFT.
  • Familiarity with AWS, Docker, Kubernetes, experiment tracking, and data or model versioning tools.
  • Preferred experience includes LLM fine-tuning, knowledge graph systems, Cassandra, Redis, SSTables, LLM judge calibration, personalization, privacy, safety guardrails, distributed systems, and service architecture.
  • Published work or patents in conversational AI, information retrieval, knowledge graphs, or efficient inference are preferred.
  • Excellent communication skills and a collaborative mindset are required.

Tech Stack

Apache CassandraAWSDockerDVCGoJavaKubernetesMLflowNeo4jPythonPyTorchRedisScala
Apple

About Apple

10,000+ employees

Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.

Contact me