7 days ago
Beijing, ChinaSenior
Responsibilities
- Own end-to-end quality by driving test strategies, comprehensive test plans, design reviews, and quality execution for Siri capabilities and services.
- Design LLM and AI evaluation schemes, benchmark datasets, adversarial and negative samples, and edge cases for conversational AI, RAG, tool-use agents, and multimodal scenarios.
- Develop AI-powered internal tools, test-generation pipelines, and self-healing test frameworks to improve engineering productivity.
- Define model quality metrics and monitoring dashboards, diagnose bad cases and failure modes, and partner with modeling and product teams on closed-loop improvements.
- Troubleshoot complex issues across client applications, cloud backend services, APIs, telemetry, logs, and AI model behavior.
- Support content safety, privacy, bias, compliance, and responsible AI risk evaluations.
- Collaborate with engineering, product, localization, and distributed cross-site teams to improve software development lifecycle quality.
Requirements
- BS/MS in Computer Science, Computer Engineering, or equivalent practical experience.
- Strong proficiency in at least one of Python, Swift, Java, or Go, with fundamentals in data structures, databases, SQL, and Unix/Linux/macOS operating systems.
- Hands-on experience architecting and implementing test automation frameworks for client applications, backend services, and end-to-end integration flows.
- Experience with CI/CD pipelines, containerization, and modern cloud or distributed infrastructure.
- Understanding of Generative AI and LLM concepts, with the ability to build tools, scripts, or workflows using model APIs.
- Strong analytical, logical, debugging, communication, and cross-functional collaboration skills.
- Professional working proficiency in written and spoken English and Mandarin.
- Preferred experience establishing LLM-driven lifecycle QA systems and automated evaluation pipelines; defining model metrics and dashboards; designing benchmarks and adversarial tests; building AI productivity tools; evaluating safety and compliance risks; and testing Apple platforms.
- Cantonese fluency or proficiency is a strong plus.
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.