Software Engineer III- AI, LLM & Data Platforms
JPMorgan Chase4 days ago
Responsibilities
- Deliver end-to-end platform features for agent-based artificial intelligence use cases through design, production deployment, monitoring, and ongoing improvement.
- Lead team adoption of enterprise-authorized AI-assisted engineering practices, including AI-assisted code review, refactoring, test acceleration, and incident or root-cause analysis support.
- Build and maintain reusable services and components for creating, evaluating, and operating LLM-powered agents at scale.
- Implement LLM evaluation and testing approaches, including quality measurement, regression testing, and error analysis.
- Develop observability capabilities using tracing, metrics, logs, and analytics to support operations and troubleshooting.
- Apply security, safety, governance, guardrails, access controls, and audit-ready practices to AI solutions.
- Collaborate with product managers and stakeholders to define success metrics, prioritize work, and deliver measurable business impact.
- Partner with engineering, data, security, risk, and compliance teams to deliver secure, stable, and scalable solutions.
- Produce documentation and reference implementations that accelerate adoption of consistent engineering practices.
Requirements
- Formal software engineering training or certification and at least 3 years of applied experience.
- Proficiency in Python and strong software engineering fundamentals, including testing, version control, and code review.
- Experience building and operating production services, including incident readiness, performance tuning, and operational stability for data-intensive systems.
- Hands-on experience delivering machine learning or LLM-enabled features into production, including monitoring and post-deployment iteration.
- Experience leading the effective use of approved AI-assisted software development tools and validating their outputs for correctness, performance, and security.
- Understanding of responsible AI engineering practices, data sensitivity, secure input and output handling, resiliency, and security expectations.
- Practical experience with prompt engineering and retrieval-augmented generation, including evaluation and quality measurement.
- Ability to design maintainable systems and make sound technical decisions amid ambiguity while balancing delivery speed, risk, and sustainability.
- Strong communication and collaboration skills for working with technical and non-technical stakeholders across teams.
- Preferred: experience with LangGraph, LlamaIndex, comparable agent orchestration approaches, or LLM evaluation tooling.
- Preferred: experience with CI/CD practices, Docker, Kubernetes, vector databases, embedding pipelines, Amazon Web Services, Databricks, or enterprise AI governance and guardrail frameworks.
Benefits
- Competitive total rewards package with base salary determined by role, experience, skills, and location; eligible roles may also receive commission or discretionary incentive compensation.
- Benefits may include comprehensive health care, on-site health and wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching.
- Equal opportunity employer that provides reasonable accommodations for religious practices, mental health needs, and physical disabilities.
Tech Stack
Categories
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.