Executive Director Machine Learning Engineer-MLOps
JPMorgan Chase3 days ago
Base Salary
$223k - $325k/yr
Responsibilities
- Build, deploy, and maintain pipelines for distributed machine learning training on GPU-enabled clusters.
- Develop and manage high-volume real-time and batch inference systems for performance and reliability.
- Implement quantization techniques and deploy open-weight large language models using serving stacks such as vLLM on Ray.
- Manage and optimize vector databases for AI and machine learning applications.
- Establish monitoring and observability pipelines for system health, performance, and issue resolution.
- Collaborate with cross-functional teams to integrate technologies and improve infrastructure.
- Partner with product, architecture, and engineering teams to define scalable and performant technical solutions.
Requirements
- BS in Computer Science or a related engineering field with 10+ years of experience, or an MS in Computer Science or a related engineering field with 6+ years of experience.
- Strong knowledge and extensive experience in Python or cloud computing and AWS.
- Experience with LLM quantization techniques such as PTQ and AWQ for accelerating inference on GPU architectures.
- Strong understanding of Transformer models and the challenges of serving large transformer-based models.
- Strong understanding of machine learning training and reinforcement learning algorithms such as GRPO and DAPO.
- Experience with caching, CUDA, autoscaling, high-throughput systems, low-latency systems, and cross-region resilient applications.
- Deep knowledge of data science fundamentals and training and deploying machine learning models.
- Experience with monitoring and observability tools for model inputs, outputs, and feature statistics.
- Strong engineering fundamentals and an analytical mindset.
- Preferred experience with recommendation and personalization systems, CUDA, Docker, Kubernetes, ECS, Ray, vLLM, verl, trl, and databases.
Benefits
- Benefits may include health care coverage, on-site health and wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching.
- Eligible roles may receive discretionary incentive compensation or commission-based pay in addition to base salary.
- The position is subject to a criminal conviction history review under Section 19 of the Federal Deposit Insurance Act.
Tech Stack
Categories
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.