2 days ago
Yokohama, JapanSenior
Responsibilities
- Own end-to-end feature quality strategy as a Feature Quality Directly Responsible Individual from feature design through public release.
- Architect deterministic test automation and agentic test harnesses for contextual, non-deterministic AI interactions.
- Develop modular test harnesses, CLI tools, and automated pipelines using Python, Swift, Objective-C, or C++.
- Design evaluation frameworks with golden datasets, LLM-as-a-judge pipelines, rubrics, semantic similarity scoring, and regression or drift detection.
- Conduct physical device and hardware/software integration testing across Apple platforms, operating systems, configurations, and ecosystem interactions.
- Perform system-level and OS-level validation involving inter-process communication, background daemons, privacy boundaries, and power or performance constraints.
- Coordinate targeted manual validation and reduce manual testing overhead through successive release cycles.
- Drive dependencies, cross-regional handoffs, and quality communication with cross-functional stakeholders.
Requirements
- Bachelor's or Master's degree in Computer Science or a related field.
- 8+ years of experience in software development or test engineering.
- Proven technical leadership and experience serving as a Feature DRI or Quality Lead.
- Strong programming fundamentals in Python and/or Swift, or Objective-C/C++.
- Experience building modular test harnesses, CLI tools, and automated pipelines.
- Hands-on experience with GenAI or agentic systems, including LLM orchestration, structured tool or function calling, prompt or context engineering, and agent execution harnesses.
- Deep understanding of test planning, risk-based testing, parameterized test frameworks, dynamic test generation, and CI/CD automation.
- Experience testing physical consumer hardware across varied operating-system configurations, environments, and ecosystem interactions.
- Experience designing evaluations for non-deterministic AI systems, including golden datasets, LLM-as-a-judge pipelines, rubric design, semantic similarity scoring, and regression or drift detection.
- Familiarity with Apple platforms and developer ecosystems, including Xcode, XCTest, and macOS or iOS system internals.
- Experience developing autonomous exploratory testing agents or autoresearch/evaluation loops.
- Strong organizational, communication, and self-direction skills.
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.