2 months ago
Base Salary
$168k - $227k/yr
Responsibilities
- Lead ranking and relevance systems for recommendations and retrieved context.
- Build offline and online agent evaluation systems using golden datasets, LLM-as-judge evaluation, regression and drift detection, and human-in-the-loop feedback.
- Design metrics and experimentation that measure task completion, recommendation acceptance, conversion, and agent quality.
- Lead development of agent orchestration, intent routing, session and memory systems, tool and function calling, and streaming capabilities.
- Define MCP tool interfaces, identity pass-through, and agent-to-service platform contracts.
- Design and scale mixture-of-experts agent architecture on Amazon Bedrock.
- Build scalable, low-latency, fault-tolerant distributed systems and support operational excellence.
- Contribute to safety and relevance guardrails, technical roadmaps, design reviews, mentoring, and cross-functional technical direction.
Requirements
- At least 5 years of non-internship professional software development experience.
- At least 5 years of programming experience with at least one software programming language.
- At least 5 years of leading the design or architecture of new and existing systems, including design patterns, reliability, and scaling.
- Experience as a mentor, tech lead, or engineering team leader.
- Preferred: at least 5 years of full software development lifecycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Preferred: bachelor’s degree in computer science or equivalent.
Benefits
- Flexible work hours and arrangements.
- Comprehensive benefits including medical, dental, vision, prescription, life and AD&D insurance, employee assistance, mental health support, medical advice, flexible spending accounts, adoption and surrogacy reimbursement, 401(k) matching, paid time off, and parental leave.
- Sign-on payments and restricted stock units are included in the Amazon package.
- Mentorship, knowledge-sharing, career growth resources, inclusive culture, and employee-led affinity groups.
- Work location: Seattle, Washington, USA; base salary is stated annually.
Tech Stack
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.