Software Engineer III - GenAI Foundational Services
JPMorgan Chase21 hours ago
Base Salary
$138k - $185k/yr
Responsibilities
- Design, develop, maintain, and troubleshoot secure Go-based backend services for LLM-enabled applications and platforms.
- Build production gRPC services defined with Protobuf, including API design, schema evolution, compatibility, and bidirectional streaming endpoints.
- Integrate LLM services with authentication, authorization, rate limits, quotas, caching, queues, streams, and persistence systems.
- Implement observability, including metrics, logging, tracing, dashboards, alerts, runbooks, and operational readiness practices.
- Participate in code reviews, debug SDK and service integrations, support incidents, and contribute to shared engineering standards.
- Identify recurring issues and develop fixes and automation to improve reliability, latency, and operational stability.
Requirements
- Formal training or certification in software engineering concepts and at least 3 years of applied experience.
- Proficiency in Go backend and service development, including goroutines, channels, context usage, and performance troubleshooting.
- Working knowledge of Python for supporting services, internal tooling, automation, evaluation harnesses, or data/ETL tasks.
- Production experience with gRPC and Protobuf, including API design and backward- and forward-compatibility practices.
- Experience building and operating production microservices and APIs with monitoring, debugging, incident support, and continuous improvement.
- Proficiency in automation and continuous delivery methods, with strong unit and integration testing discipline.
- Proficiency in secure coding practices and core software development lifecycle activities.
- Preferred experience with end-to-end LLM streaming, tool or function calling orchestration, session state management, and safety or guardrail hooks.
- Preferred familiarity with OpenTelemetry, Kubernetes, Docker, Kafka, RabbitMQ, SQS, Redis, RPC security, and AI/LLM cost management.
Benefits
- Competitive total rewards and benefits package, with base salary determined by role, experience, skill set, and location.
- Eligible roles may receive commission-based pay or discretionary incentive compensation in cash or forfeitable equity.
- Benefits may include comprehensive health care, on-site health and wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching.
Tech Stack
Categories
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.