
Lead Software Engineer - Java/Python with AI
JPMorgan Chase5 hours ago
Bengaluru, IndiaStaff+
Responsibilities
- Design, develop, and troubleshoot LLM-powered applications and services, including retrieval-augmented generation, agent workflows, structured extraction, and classification.
- Build LLM-assisted microservices and inference pipelines with deterministic fallbacks, circuit breakers, observability, and resilience controls.
- Define and enforce guardrails for prompts, retrieved context, model inputs and outputs, PII redaction, safety filters, hallucination mitigation, output schemas, and policy compliance.
- Provide L3 and BAU production support, own complex incidents, manage model and prompt rollouts or rollbacks, and support on-call coverage for LLM services and dependencies.
- Establish AI-assisted engineering practices, validation standards, automated evaluations, regression testing, code-review practices, and reusable engineering patterns.
- Develop architecture artifacts, model cards, data lineage, RAG and agent reference architectures, prompt libraries, evaluation plans, and control evidence.
- Improve model selection, prompt strategies, retrieval quality, chunking and embedding strategies, and system architecture using telemetry, error analysis, analytics, and drift detection.
- Drive LLMOps practices across environments, including approvals, segregation of duties, reproducibility, lifecycle management, canary releases, and rollback strategies.
- Ensure LLM-driven systems meet reliability, disaster recovery, regional resiliency, performance SLO, latency, cost, and SLA expectations.
- Coach engineers on secure, compliant, and responsible adoption of AI-assisted software development tools.
Requirements
- Formal training or certification in software engineering concepts and at least 5 years of applied experience.
- Strong Java, Python, and SQL skills for building LLM-enabled microservices, retrieval pipelines, evaluators, and data tooling.
- Hands-on AWS and cloud data-management experience, including Redshift, DynamoDB, Aurora, or Databricks, plus managed model endpoints and embedding or vector services.
- Experience with system design, application development, operational stability, retrieval layers, vector stores, caching, observability, rate limiting, and backpressure.
- Experience with automation, CI/CD practices, prompt and configuration versioning, automated evaluations, canary releases, and rollback strategies.
- Expert-level understanding of large language models and hands-on experience training and fine-tuning approved models such as Claude and ChatGPT.
- Strong understanding of embeddings, chunking strategies, vector similarity, retrieval-quality measures, data modeling, and document lineage.
- Experience integrating LLMs as controlled, reliable components in regulated environments with determinism, reproducibility, safety, and traceability.
- Strong analytical, problem-solving, communication, and stakeholder-explanation skills, including the ability to explain model behavior, tradeoffs, and control decisions.
- Preferred experience defining model-usage guidelines, translating business and regulatory requirements into technical controls, and maintaining versioned, reviewable prompt libraries.
- Preferred experience with prompt-driven design, constrained decoding, seeded examples, output schemas, canonical evaluation sets, and reusable retrieval and guardrail components.
- Ability to continuously learn developments in agentic AI and LLM-driven software development and take full ownership of assigned work.
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.