1 day ago
Responsibilities
- Design and develop benchmarks, evaluators, simulation environments, and prompt and context optimization pipelines.
- Evaluate models through offline benchmarks, device-in-the-loop simulation, and on-device production observation.
- Convert failure analysis into datasets, reward signals, and measurable model and agent improvements.
- Build and maintain ML infrastructure for evaluation, training, or deployment.
- Define problems and metrics, build end-to-end solutions, and demonstrate measured impact.
- Lead technical work across multiple codebases, teams, and organizations.
Requirements
- Strong background in machine learning and distributed systems.
- Proven track record solving ambiguous problems end to end, from problem and metric definition through implementation and impact measurement.
- Experience building and maintaining ML infrastructure for evaluation, training, or deployment.
- At least 6 years of professional software engineering experience, preferably in machine learning or a related field.
- Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.
- Preferred experience with LLM evaluation, LLM-as-judge, reward modeling, prompt optimization, agent harness development, or post-training methods such as SFT, DPO, and RLHF.
- Preferred proficiency in Python and ML frameworks such as PyTorch or JAX.
- Preferred experience with agentic systems, simulation environments, trajectory-based data generation, on-device ML, or privacy-preserving ML.
- Understanding of post-training data usage and how data choices affect model behavior.
- Excellent communication skills.
Categories
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.