2 days ago
Responsibilities
- Partner with the Operations Product Manager to assess technical feasibility and apply responsible AI principles.
- Curate and own golden datasets and evaluation sets for training, testing, and benchmarking.
- Lead rapid proofs of concept, testing plans, controlled experiments, and performance measurement against baselines.
- Build workflows combining LLMs and multimodal models with prompting, structured outputs, retrieval, tools, and failure handling.
- Design evaluations with domain experts, select relevant metrics, and validate results against benchmarks and human-level performance where applicable.
- Produce technical write-ups, demos, recommendations, specifications, and hands-on guidance for engineering handoff.
- Validate production systems after launch against original POC results and contribute to long-term AI strategy and roadmap recommendations.
Requirements
- Bachelor’s or master's degree in Computer Science, AI/ML, Data Science, or a related field, completed or expected by the start date.
- Strong Python skills, including pandas, SQL, REST APIs, and structured data such as JSON and XML.
- Hands-on experience building AI applications with LLM APIs through coursework, research, internships, or projects, including prompting, structured outputs, RAG, or tool-using workflows.
- Working knowledge of ML evaluation, including precision, recall, F1, test-set construction, experiment design, and baseline validation.
- Understanding of AI guardrails covering safety, privacy, compliance, and responsible deployment.
- Proficiency with LLM-assisted coding tools and clear written and verbal communication.
- Preferred experience includes end-to-end AI system research or internships, rapid prototyping, requirements translation, technical specifications, multimodal models, video/audio processing, LLM-as-judge evaluation, open-weight model serving, agent frameworks, observability, monitoring, cloud or ML infrastructure, and React/TypeScript demos.
Tech Stack
Categories
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.