Senior Lead Software Engineer- Inference platform engineer
JPMorgan ChaseResponsibilities
- Provide technical guidance to engineers, contractors, and vendors while aligning technical decisions with business goals.
- Develop, review, debug, and improve secure, high-quality production code.
- Architect, deploy, monitor, manage, and optimize secure and scalable cloud platforms for AI/ML workloads.
- Translate AI team compute requirements into infrastructure requirements and influence product design, functionality, and technical operations.
- Build CI/CD automation and infrastructure-as-code to streamline ML deployment and operations.
- Operate Kubernetes and containerized environments, including production troubleshooting and cluster operations.
- Drive adoption, governance, validation, and reuse of approved AI-assisted engineering practices across the SDLC/TLM toolchain.
- Promote responsible AI use, secure handling of sensitive inputs and outputs, and compliant engineering workflows.
Requirements
- Formal training or certification in software engineering concepts and 5+ years of applied experience.
- Hands-on experience with system design, application development, testing, and operational stability.
- Strong Kubernetes and Docker experience, including cluster operations and production troubleshooting.
- Proficiency in at least one of Python, Go, Java, or C#.
- Knowledge of IaaS, PaaS, SaaS, and public, private, and hybrid cloud deployment models.
- Foundational understanding of machine learning, transformer architecture, ML training, and inference.
- Experience with infrastructure-as-code and cloud component architecture, including microservices, storage, security, and routing/switching technologies.
- Experience leading the effective use of enterprise-authorized AI-assisted software development tools and validating their outputs for correctness, performance, and security.
- Understanding of responsible AI practices, data sensitivity, secure input/output handling, resiliency, and security controls, including coaching senior engineers or leads.
- Preferred experience with NVIDIA GPU infrastructure software, Prometheus, Grafana, MLflow, and high-performance LLM inference platforms using vLLM and GPU/CPU serving optimization.
Benefits
- Competitive total rewards and benefits are offered based on eligibility.
- Benefits include comprehensive health care coverage, on-site health and wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching.
- JPMorgan Chase provides equal opportunity employment and reasonable accommodations for religious practices and mental or physical disabilities.
Tech Stack
Categories
About JPMorgan Chase
With a history tracing its roots to 1799 in New York City, JPMorganChase is one of the world's oldest, largest, and best-known financial institutions—carrying forth the innovative spirit of our heritage firms in global operations across 100 markets. We serve millions of customers and many of the world’s most prominent corporate, institutional, and government clients daily, managing assets and investments, offering business advice and strategies, and providing innovative banking solutions and services. Social Media Terms and Conditions: https://bit.ly/JPMCSocialTerms JPMorgan Chase & Co. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.