Senior Lead Software Engineer- AI/ML Training Infrastructure
JPMorgan Chase2 months ago
Base Salary
$176k - $260k/yr
Responsibilities
- Design, develop, test, review, debug, and improve secure production code.
- Architect, build, and operate cloud infrastructure optimized for multi-GPU and multi-node AI/ML training workloads.
- Translate compute, storage, networking, GPU, and scalability requirements into robust platform capabilities with AI/ML, data science, and platform teams.
- Drive technical decisions affecting product architecture, infrastructure strategy, reliability, performance, and operational effectiveness.
- Monitor and optimize cloud and GPU resources for performance, utilization, scalability, reliability, and cost efficiency.
- Build and maintain automation frameworks, CI/CD pipelines, and infrastructure-as-code solutions for ML platform deployment and lifecycle management.
- Provide technical leadership to engineers, contractors, and vendor partners.
- Promote secure coding, resiliency, SDLC, operational, and responsible AI-assisted engineering practices.
- Establish validation standards and governance for AI-assisted coding, review, testing, troubleshooting, and incident analysis.
Requirements
- Formal training or certification in software engineering concepts and 5+ years of applied experience.
- Hands-on experience building highly scalable and highly available infrastructure for machine learning training and/or inference.
- Strong understanding of GPU infrastructure, accelerators, high-speed interconnects, distributed compute, and related platform technologies.
- Strong Kubernetes and containerization experience, including Docker, cluster operations, workload scheduling, observability, and production troubleshooting.
- Proficiency in at least one modern programming language such as Python, Go, Java, or C#.
- Ability to independently solve complex design, scalability, reliability, performance, and functionality challenges.
- Deep understanding of cloud component architecture, including compute, storage, networking, security, routing, and switching.
- Experience leading enterprise-authorized AI-assisted software development tools and validating AI outputs for correctness, performance, and security.
- Understanding of responsible AI use, data sensitivity, secure input/output handling, resiliency, security expectations, and compliant usage coaching.
- Preferred experience with performance monitoring, production debugging, profiling, sampling, bottleneck analysis, and capacity optimization.
- Preferred familiarity with NVIDIA infrastructure software and tooling such as DCGM, BCM, NVIDIA drivers, CUDA, and training libraries.
- Preferred experience with MLOps platforms such as MLflow, distributed systems, distributed training, Ray.io, Slurm, or similar orchestration technologies.
- Preferred knowledge of high-throughput and low-latency networking, cloud data services, big data processing, Linux, and large-scale storage technologies.
- Preferred experience designing platforms for model training, experiment tracking, feature pipelines, model serving, and scalable inference.
Benefits
- Competitive total rewards package with base salary determined by role, experience, skill set, and location, plus possible incentive compensation for eligible roles.
- Benefits may include comprehensive health care, on-site health and wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching.
- Employment is contingent on review of criminal conviction history under Section 19 of the Federal Deposit Insurance Act.
Categories
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.