Lead Software Engineer - AI/ML - AI Agent Platform
JPMorgan Chase13 hours ago
Base Salary
$157k - $215k/yr
Responsibilities
- Lead end-to-end delivery of the AI Agent Platform SDK and frameworks from technical design through production deployment, scaling, monitoring, and ongoing operations.
- Own reusable platform capabilities including agent orchestration, tool and function calling, retrieval-augmented generation, and model-serving integration.
- Build voice agents, document-extraction agents, and agentic memory capabilities covering speech, OCR, structured extraction, persistence, retrieval, and context management.
- Develop evaluation datasets, benchmarks, regression suites, quality metrics, tracing, telemetry, logs, and analytics to improve agent accuracy, latency, cost, and reliability.
- Set engineering standards through system design, code review, mentorship, testing, and documentation.
- Implement safety and governance controls including guardrails, content filtering, prompt-injection defenses, access controls, and audit-ready practices.
- Partner with product, engineering, data, security, and risk stakeholders to define roadmaps, metrics, priorities, and measurable outcomes.
Requirements
- Formal training or certification in applied artificial intelligence and machine learning, plus 5+ years of applied experience.
- Advanced Python proficiency and strong software engineering fundamentals, including testing, design patterns, version control, and code review.
- Hands-on experience building, evaluating, and deploying machine-learning or large-language-model-enabled systems in production, preferably reusable libraries, SDKs, or platform services.
- Practical experience with prompt engineering and retrieval-augmented generation, including evaluation methods, benchmarks, and quality measurement for capabilities such as NL2SQL and RAG.
- Experience designing and operating reliable data-intensive services, including performance tuning, incident-response readiness, and operational stability.
- Ability to lead technical decisions and deliver outcomes amid ambiguity while balancing speed, risk, and maintainability.
- Strong communication skills for explaining technical trade-offs to technical and non-technical stakeholders.
- Preferred experience with LangGraph, LlamaIndex, Google ADK, custom orchestration, LLM evaluation tooling, voice agents, document-processing agents, agentic memory, vector databases, embedding pipelines, graph-based memory, Docker, Kubernetes, and cloud or machine-learning platforms such as AWS and Databricks.
Benefits
- Competitive total rewards package with base salary determined by role, experience, skills, and location.
- Eligible roles may receive commission-based pay or discretionary incentive compensation in cash or forfeitable equity.
- Comprehensive health care coverage and on-site health and wellness centers.
- Retirement savings plan, backup childcare, tuition reimbursement, mental health support, and financial coaching.
- Equal opportunity employer with reasonable accommodation support.
Tech Stack
Categories
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.