Senior Lead Software Engineer- Inference platform engineer
JPMorgan Chase2 months ago
Base Salary
$176k - $260k/yr
Responsibilities
- Provide technical guidance to engineers, contractors, and vendors while aligning technical decisions with business goals.
- Develop, review, debug, and improve secure, high-quality production code.
- Architect, deploy, monitor, manage, and optimize secure and scalable cloud platforms for AI/ML workloads.
- Translate AI team compute requirements into infrastructure requirements and influence product design, functionality, and technical operations.
- Build CI/CD automation and infrastructure-as-code to streamline ML deployment and operations.
- Operate Kubernetes and containerized environments, including production troubleshooting and cluster operations.
- Drive adoption, governance, validation, and reuse of approved AI-assisted engineering practices across the SDLC/TLM toolchain.
- Promote responsible AI use, secure handling of sensitive inputs and outputs, and compliant engineering workflows.
Requirements
- Formal training or certification in software engineering concepts and 5+ years of applied experience.
- Hands-on experience with system design, application development, testing, and operational stability.
- Strong Kubernetes and Docker experience, including cluster operations and production troubleshooting.
- Proficiency in at least one of Python, Go, Java, or C#.
- Knowledge of IaaS, PaaS, SaaS, and public, private, and hybrid cloud deployment models.
- Foundational understanding of machine learning, transformer architecture, ML training, and inference.
- Experience with infrastructure-as-code and cloud component architecture, including microservices, storage, security, and routing/switching technologies.
- Experience leading the effective use of enterprise-authorized AI-assisted software development tools and validating their outputs for correctness, performance, and security.
- Understanding of responsible AI practices, data sensitivity, secure input/output handling, resiliency, and security controls, including coaching senior engineers or leads.
- Preferred experience with NVIDIA GPU infrastructure software, Prometheus, Grafana, MLflow, and high-performance LLM inference platforms using vLLM and GPU/CPU serving optimization.
Benefits
- Competitive total rewards and benefits are offered based on eligibility.
- Benefits include comprehensive health care coverage, on-site health and wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching.
- JPMorgan Chase provides equal opportunity employment and reasonable accommodations for religious practices and mental or physical disabilities.
Tech Stack
Categories
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.