Software Engineer III - Python LLM Engineer
JPMorgan Chase2 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design and build agentic AI workflows with multi-step reasoning, tool orchestration, task execution, fallback behavior, and human approvals.
- Develop and productionize LLM-powered conversational, search, summarization, extraction, and advisory applications.
- Implement secure tool integrations with APIs, internal services, and data sources using authentication, authorization, audit logging, and least-privilege access.
- Build and tune RAG ingestion, indexing, retrieval, grounding, citation, and reranking components.
- Produce distributed-system architecture and design artifacts addressing service boundaries, data flows, scalability, resiliency, latency, throughput, and availability.
- Establish offline evaluations, regression checks, prompt and version management, hallucination and grounding checks, runtime traces, latency monitoring, cost monitoring, and tool-call success metrics.
- Apply data cleaning, normalization, deduplication, exploratory analysis, and KPI reporting to support AI features.
- Use authorized AI-assisted development tools for coding, testing, troubleshooting, refactoring, and documentation while validating outputs.
- Collaborate with product, design, and stakeholders to deliver secure, privacy-conscious, compliant, and responsible AI solutions.
- Mentor engineers and contribute shared standards, reusable components, and engineering best practices.
Requirements
- Formal software engineering training or certification and at least 3 years of applied experience.
- Experience delivering production software applications and services.
- Strong Python proficiency and experience with APIs and microservices.
- Hands-on experience building LLM, RAG, or agentic applications, including prompting, structured outputs, tool or function calling, state management, and error handling.
- Familiarity with agent frameworks such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, CrewAI, or AutoGen.
- Working knowledge of data cleaning, joins, aggregations, basic statistics, exploratory analysis, SQL, and pandas-style workflows.
- Experience with AWS or Azure, observability, operational reliability practices, and software development lifecycle tooling.
- Hands-on experience using authorized AI-assisted software development tools and critically evaluating and refining generated outputs for correctness, performance, and security.
- Understanding of responsible AI, data sensitivity, secure input and output handling, resiliency, and secure development practices.
- Preferred experience with vector search, embeddings, reranking, query rewriting, regulated environments, or strict audit and security requirements.
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.