2 days ago
Responsibilities
- Lead qualification of LLM inference and output-correctness automation for large-scale AI data center deployment.
- Architect evaluation and qualification systems for generative AI, including agentic workflows and tool-using models.
- Validate correctness, consistency, and stability across models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware.
- Write production-quality software in Python, C++, and/or Swift for AI systems qualification and testing.
- Apply statistical and machine-learning evaluation methods to validate model behavior and data.
- Build AI-assisted QA tooling for test-case generation, defect detection, and reduced manual testing.
- Integrate automated evaluations into release pipelines and partner with ML, inference, distributed systems, and platform teams.
- Define quality standards for probabilistic and non-deterministic LLM inference at scale.
Requirements
- At least 1 year of experience with hardware and/or software development lifecycle processes.
- At least 1 year of experience with one or more compiled languages such as C, C++, Objective-C, or Swift.
- Proficiency in a scripting language such as Python, Go, or JavaScript.
- Experience using AI or LLMs to improve testing, including test-case generation, defect detection, or QA automation.
- Familiarity with LLM serving, inference optimization, GPU-accelerated software, and techniques including batching, KV-cache, quantization, speculative decoding, and distributed multi-accelerator serving.
- Experience with Kubernetes, containers, cloud-native systems, and automated evaluation integration.
- Experience with machine learning, LLMs, and frameworks such as PyTorch or Hugging Face Transformers.
- Experience with observability, distributed tracing, and model-drift monitoring using tools such as Splunk, Prometheus, Grafana, or LangSmith.
- B.S., M.S., or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or equivalent experience.
- Preferred: 5+ years using Python, Go, or JavaScript.
- Preferred: 5+ years working with and building operating systems.
- Preferred: 2+ years of LLM testing or development.
Tech Stack
CC++GoGrafanaHugging Face TransformersJavaScriptKubernetesObjective-CPrometheusPythonPyTorchSplunkSwift
Categories
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.
