Software Engineer III- AI, LLM & Data Platforms
JPMorgan Chase15 hours ago
Responsibilities
- Deliver end-to-end platform features for agent-based artificial intelligence use cases through design, production deployment, monitoring, and improvement.
- Build reusable services and components for creating, evaluating, and operating LLM-powered agents at scale.
- Implement LLM evaluation, quality measurement, regression testing, and error analysis approaches.
- Develop observability capabilities including tracing, metrics, logs, and analytics.
- Apply security, safety, governance, guardrail, access-control, and audit-ready operational practices.
- Lead adoption of enterprise-authorized AI-assisted engineering tools and establish validation standards for their outputs.
- Collaborate with product managers and cross-functional engineering, data, security, risk, and compliance stakeholders.
- Create documentation and reference implementations that promote consistent engineering practices.
Requirements
- Formal training or certification in software engineering concepts and 3+ years of applied experience.
- Proficiency in Python and strong software engineering fundamentals, including testing, version control, and code review.
- Experience building and operating production services, including incident readiness, performance tuning, and operational stability for data-intensive systems.
- Hands-on experience delivering machine learning or LLM-enabled features into production, including monitoring and post-deployment iteration.
- Experience leading approved AI-assisted software development practices and validating AI outputs for correctness, performance, and security.
- Understanding of responsible AI engineering workflows, data sensitivity, secure input/output handling, resiliency, and security expectations.
- Practical experience with prompt engineering and retrieval-augmented generation, including evaluation and quality measurement.
- Ability to design maintainable systems, make technical decisions under ambiguity, and balance delivery speed, risk, and sustainability.
- Strong communication and collaboration skills with technical and non-technical stakeholders.
- Preferred: experience with LangGraph, LlamaIndex, LLM evaluation tooling, Docker, Kubernetes, vector databases, embedding pipelines, AWS, Databricks, or enterprise AI governance and guardrail frameworks.
Benefits
- Competitive total rewards and benefits package, with benefits determined by eligibility.
- Comprehensive health care coverage and on-site health and wellness centers.
- Retirement savings plan, backup childcare, tuition reimbursement, mental health support, and financial coaching.
- Eligible roles may include commission-based pay or discretionary incentive compensation in cash or forfeitable equity.
- The posting does not specify a remote or hybrid work arrangement.
Tech Stack
Categories
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.