ML Ops Engineer
Eli Lilly and Company24 hours ago
San Francisco, CA, USAMid Level
Base Salary
$147k - $268k/yr
Responsibilities
- Lead the operational lifecycle of machine learning models, including deployment, monitoring, retraining, and reliability.
- Operate and optimize large-scale inference platforms and GPU infrastructure for scientific discovery and AI workloads.
- Ensure models are scalable, maintainable, monitored, and production-ready.
- Test, refine, and improve model accuracy.
- Collaborate with data scientists, business analysts, research scientists, AI engineers, infrastructure teams, and partners to integrate ML models into broader strategies.
- Automate infrastructure with infrastructure-as-code and CI/CD tools and document platforms for reliable operation.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Statistics, Mathematics, or a related technical field.
- At least 4 years of experience in machine learning engineering, ML Ops, or platform engineering.
- Strong Python skills and experience with machine learning frameworks such as PyTorch, JAX, or TensorFlow.
- Experience deploying, operating, and scaling production ML platforms, including model serving, monitoring, and large-scale inference.
- Experience with MLOps tools such as MLflow, Weights & Biases, or KServe.
- Proficiency with Docker, Kubernetes, Slurm, Ray, or comparable containerization, orchestration, and distributed-compute technologies.
- Experience with large-scale AI platform technologies such as Triton, vLLM, or TensorRT-LLM.
- Experience with infrastructure automation and CI/CD tools such as Terraform, Ansible, or GitHub Actions.
- Experience supporting AWS, Azure, or GCP and on-premises GPU infrastructure.
- Knowledge of observability, monitoring, metrics, logging, tracing, performance tuning, and automated system or model performance improvement.
Benefits
- Flexible hybrid schedule with three days onsite and two days remote each week at the Silicon Valley Hub.
- Company bonus eligibility for full-time equivalent employees.
- Comprehensive benefits including 401(k), pension, vacation, medical, dental, vision, prescription drug, flexible spending, life insurance, leave, wellness, fitness, employee assistance, and employee club benefits.
Tech Stack
AnsibleAWSAzureDockerGitHub ActionsGoogle Cloud PlatformKubernetesMLflowPythonPyTorchTensorFlowTerraform
Categories
About Eli Lilly and Company
Eli Lilly and Company researches, develops, manufactures, and markets prescription medicines and biologics for patients, sold through healthcare providers, pharmacies, and payers. Core therapeutic areas include diabetes, oncology, immunology, neuroscience, and obesity. Founded in 1876 and headquartered in Indianapolis, it is a public company (NYSE: LLY) with global operations and is building a new advanced manufacturing site for gene therapy and other modalities in Lebanon, Indiana.