13 hours ago
Cupertino, CA, USAMid Level
H1B sponsor
Responsibilities
- Design and build tools and systems for automatic evaluation of Apple AI products.
- Develop extensible frameworks, pipelines, and tools for AI model development, deployment, and qualitative measurement.
- Build LLM applications, evaluation frameworks, and offline evaluation systems.
- Create scalable tools that improve product quality evaluation and development efficiency.
- Interpret evaluation reports and metrics such as precision, recall, and run-to-run consistency.
- Translate ambiguous product requirements into software solutions and collaborate with cross-functional teams.
Requirements
- Bachelor’s, master’s, or PhD degree in Computer Science, Machine Learning, AI, or a related field.
- Exceptional Python skills and strong software engineering fundamentals.
- Production experience with system design, API design, testing strategies, code maintainability, system monitoring, and debugging complex systems.
- Expertise using AI-assisted software development workflows while maintaining code quality.
- Experience building LLM applications, frameworks, and offline evaluations.
- Familiarity with MLOps principles for model lifecycle management.
- Experience building scalable tools for product quality evaluation.
- Ability to understand evaluation reports, precision, recall, run-to-run consistency, and data leakage risks.
- Strong communication, collaboration, and product-thinking skills.
Tech Stack
Categories
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.