Software Engineer III - AIML
JPMorgan Chase6 hours ago
Base Salary
$138k - $185k/yr
Responsibilities
- Design, develop, and troubleshoot LLM-enabled applications and platforms.
- Design, build, and maintain secure, high-quality Go backend services.
- Build gRPC services defined with Protobuf, including API design, schema evolution, and compatibility practices.
- Implement bidirectional streaming gRPC endpoints for interactive LLM sessions, partial responses, incremental results, cancellations, and flow control.
- Integrate LLM services with authentication and authorization, rate limits, caching, queues or streams, and persistence systems.
- Review and debug SDK and service integrations, participate in code reviews, and contribute to shared engineering standards.
- Instrument services with metrics, logging, and tracing, and contribute to runbooks, alerts, dashboards, and on-call readiness.
- Identify recurring issues and develop fixes and automation to improve reliability, latency, and operational stability.
- Use enterprise-authorized AI-assisted development tools for coding, refactoring, testing, troubleshooting, and documentation while validating outputs for correctness, performance, and security.
Requirements
- Formal training or certification in software engineering concepts and at least 3 years of applied experience.
- Proficiency in Go for backend and service development, including goroutines, channels, context usage, and performance troubleshooting.
- Working knowledge of Python for supporting services, internal tooling, automation, evaluation harnesses, or data and ETL tasks.
- Production experience with gRPC and Protobuf, including API design and backward and forward compatibility.
- Experience building and operating production microservices and APIs, including monitoring, debugging, incident support, and continuous improvement.
- Proficiency in automation and continuous delivery methods with strong unit and integration testing discipline.
- Proficiency in secure coding practices and core software development lifecycle activities.
- Hands-on experience with enterprise-authorized AI-assisted software development tools and the ability to evaluate, validate, and refine generated outputs.
- Understanding of responsible AI use in engineering workflows, data sensitivity, secure input and output handling, resiliency, and security expectations.
- Preferred: experience building end-to-end LLM streaming experiences, including tool or function calling orchestration, session state, and safety or guardrail hooks.
- Preferred: familiarity with OpenTelemetry and observability patterns for streaming RPCs.
- Preferred: experience with Kubernetes, Docker, messaging and streaming systems, caching, secure RPC practices, and AI/LLM cost management.
Benefits
- Competitive total rewards package with base salary determined by role, experience, skill set, and location.
- Eligible roles may receive commission-based pay or discretionary incentive compensation in cash or forfeitable equity.
- Comprehensive health care coverage.
- On-site health and wellness centers.
- Retirement savings plan.
- Backup childcare.
- Tuition reimbursement.
- Mental health support and financial coaching.
Tech Stack
Categories
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.