Apple

Sr Software Engineer - LLM Evaluation and Test Infrastructure

Apple
Apply
18 hours ago
Cupertino, CA, USASenior
H1B sponsor

Responsibilities

  • Define and develop online and offline validation infrastructure for generative AI systems.
  • Build scalable automation tools, frameworks, and client- and server-side CI pipelines across Apple platforms.
  • Enable rigorous testing of generative AI model accuracy, performance, reliability, and stability across products and use cases.
  • Collaborate with machine learning engineers, data scientists, software developers, product managers, and program teams.
  • Align validation infrastructure development with feature and product roadmaps and drive adoption among product and ML engineers.

Requirements

  • Bachelor’s or master’s degree in Computer Science, Machine Learning, or a related field.
  • At least 6 years of software development experience with Java, Python, Swift, or Objective-C.
  • Strong software engineering skills for scalable infrastructure supporting generative AI training and inference pipelines.
  • Fundamental knowledge of machine learning concepts and ML product lifecycle and operations.
  • Familiarity with PyTorch, TensorFlow, or SkLearn.
  • Hands-on experience building automation infrastructure, tools, and frameworks for large-scale AI/ML or cloud-based applications.
  • Experience evaluating and testing machine learning models, including performance metrics, validation techniques, and statistical analysis.
  • Strong communication, collaboration, adaptability, and creative problem-solving skills.

Tech Stack

JavaObjective-CPythonPyTorchscikit-learnSwiftTensorFlow
Apple

About Apple

10,000+ employees

Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.

Contact me