ML Ops Engineer
Eli Lilly and Company12 days ago
South San Francisco, CA, USAMid Level
Base Salary
$147k - $268k/yr
Responsibilities
- Lead the operational lifecycle of ML models, including deployment, monitoring, reliability, and ongoing maintenance.
- Operate and optimize large-scale inference platforms for scientific discovery and AI workloads.
- Ensure models can be deployed, scaled, monitored, and maintained in production.
- Test, refine, and improve model accuracy.
- Collaborate with data scientists, business analysts, engineering teams, and partners to integrate ML models into broader strategies.
- Automate platforms using infrastructure-as-code and CI/CD, and document systems for operational handoff.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Statistics, Mathematics, or a related technical field.
- At least 4 years of experience in machine learning engineering, ML Ops, or platform engineering.
- Strong Python skills and experience with machine learning frameworks such as PyTorch, JAX, or TensorFlow.
- Experience deploying, operating, and scaling production ML platforms, including model serving, monitoring, and large-scale inference.
- Experience with MLOps platforms and tools such as MLflow, Weights & Biases, or KServe.
- Proficiency with Docker, Kubernetes, Slurm, Ray, and distributed compute environments.
- Experience operating AI platforms using technologies such as Triton, vLLM, or TensorRT-LLM.
- Experience with infrastructure automation and CI/CD tools such as Terraform, Ansible, or GitHub Actions.
- Experience supporting AWS, Azure, or GCP and on-premises GPU infrastructure.
- Knowledge of observability, monitoring, metrics, logging, tracing, and performance tuning.
- Ability to resolve system, infrastructure, and model performance issues through automation and continuous improvement.
- Ability to collaborate with research scientists, AI engineers, and infrastructure teams in a fast-paced environment.
Benefits
- Hybrid work model with three days onsite and two days working remotely each week at the Silicon Valley Hub.
- Eligible full-time employees may receive a company bonus based partly on company and individual performance.
- Benefits may include a 401(k), pension, vacation, medical, dental, vision, prescription drug, flexible spending, life insurance, leave, well-being, fitness, employee assistance, and employee club benefits.
Tech Stack
AnsibleAWSAzureDockerGitHub ActionsGoogle Cloud PlatformKubernetesMLflowPythonPyTorchTensorFlowTerraform
Categories
About Eli Lilly and Company
Eli Lilly and Company researches, develops, manufactures, and markets prescription medicines and biologics for patients, sold through healthcare providers, pharmacies, and payers. Core therapeutic areas include diabetes, oncology, immunology, neuroscience, and obesity. Founded in 1876 and headquartered in Indianapolis, it is a public company (NYSE: LLY) with global operations and is building a new advanced manufacturing site for gene therapy and other modalities in Lebanon, Indiana.