1 day ago
Cupertino, CA, USA +3 moreMid Level
H1B sponsor
Responsibilities
- Build and maintain intelligent systems, validation frameworks, synthetic data generation models, and monitoring pipelines for ML and GenAI data quality.
- Own the health of training and validation datasets across Wallet, Payments, and Commerce.
- Define and analyze model observability, performance, drift, robustness, and confidence metrics in production.
- Lead telemetry analysis across GenAI workflows and translate data quality and model health findings into actionable insights.
- Collaborate with Data Engineering, Privacy, Legal, engineering, and non-technical stakeholders.
Requirements
- Bachelor’s degree with exceptional hands-on experience in ML/AI model quality or applied research, or an M.S. or Ph.D. in Machine Learning, Computer Science, Data Science, Statistics, Mathematics, Engineering, or a related quantitative field.
- At least 3 years of experience defining and tracking production ML model health metrics, including performance monitoring, feature drift detection, and observability instrumentation.
- At least 3 years of experience in machine learning, data science, or a closely related analytical role focused on data quality, model evaluation, or ML observability in production.
- Proficiency in Python, Pandas, NumPy, Scikit-learn, PyTorch, and SQL.
- Experience analyzing large-scale datasets with distributed computing frameworks such as PySpark, Spark, or distributed SQL.
- Understanding of hypothesis testing, distribution analysis, data drift detection, and statistical process control.
- Experience with GenAI or LLM systems, quality failure modes, output evaluation, and telemetry instrumentation.
- Preferred experience includes Tableau, Apache Superset, Databricks, LangSmith, LLM-as-a-judge techniques, Bayesian or causal graph-based synthetic data generation, confidence calibration, uncertainty quantification, MLflow, Weights & Biases, privacy-constrained data, GDPR, DMA, and financial services or payment products.
Tech Stack
Categories
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.