23 hours ago
Responsibilities
- Own the conversational intelligence layer, including agent reasoning, planning, tool calling, and low-latency LLM inference.
- Design multi-turn conversational experiences and build intent, slot, clarification, and disambiguation capabilities.
- Build and optimize production LLM and ML serving systems using inference optimization, caching, profiling, and model compression techniques.
- Deploy and serve LLMs or ML models directly in production request paths.
- Build and scale knowledge graph, lookup, retrieval, and real-time data services to keep responses accurate and grounded.
- Develop automated and LLM-as-judge evaluations for multi-turn conversations and integrate them into development workflows.
- Implement personalization, memory, privacy protections, and safety guardrails for LLM-powered agents.
- Architect and lead projects with cross-functional stakeholders across Apple.
Requirements
- Master's degree in Computer Science, Machine Learning, NLP, or a related field; a Ph.D. is preferred.
- At least 7 years of experience as a software or machine learning engineer, with significant focus on conversational AI, search, or LLM-powered systems.
- Strong programming skills in Go and Python, plus at least one of Java or Scala.
- Hands-on experience shipping conversational AI or dialogue systems, including intent and slot understanding, multi-turn context, clarification, and disambiguation.
- Production experience building LLM-powered applications with prompt design, tool or function calling, structured output generation, and agentic orchestration.
- Experience optimizing LLM inference through distillation, quantization, batching, KV-cache tuning, caching, and profiling.
- Experience deploying production-path LLM or ML serving systems with frameworks such as vLLM, SGLang, Triton, or TorchServe.
- Experience with knowledge graphs, low-latency lookup and retrieval services, and preferably graph schemas, ingestion pipelines, or graph databases.
- Fluency with PyTorch and the Hugging Face ecosystem, including transformers and PEFT.
- Familiarity with AWS, Docker, Kubernetes, experiment tracking, and data or model versioning tools.
- Preferred experience includes LLM fine-tuning, knowledge graph systems, Cassandra, Redis, SSTables, LLM judge calibration, personalization, privacy, safety guardrails, distributed systems, and service architecture.
- Published work or patents in conversational AI, information retrieval, knowledge graphs, or efficient inference are preferred.
- Excellent communication skills and a collaborative mindset are required.
Categories
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.
