24 hours ago
Base Salary
$168k - $227k/yr
Responsibilities
- Lead the architecture, design, and delivery of large-scale distributed, low-latency Search Navigation services.
- Own technical direction for online LLM serving, including GPU and accelerator inference, personalization, asynchronous rendering, caching, and cost and latency optimization.
- Drive the roadmap for Smart Refinement and multi-turn conversational refinement.
- Build safe and reliable GenAI experiences with input controls, output validation, filtering, and graceful fallbacks.
- Partner with Applied Scientists, Product Managers, and Program Managers to bring LLM innovations and distilled models into production.
- Build scalable data pipelines processing petabytes of search and behavioral data for feature generation, model training, distillation, and evaluation.
- Design, run, and analyze online A/B experiments and make data-driven launch recommendations.
- Own operational excellence for critical services, including monitoring, on-call health, P0 metrics, defect guardrails, availability, and latency.
- Lead cross-team initiatives, influence technical decisions, and mentor engineers.
Requirements
- At least 5 years of non-internship professional software development experience.
- At least 5 years of programming experience with at least one software programming language.
- At least 5 years of experience leading the design or architecture of new and existing systems, including reliability and scaling.
- Experience as a mentor, tech lead, or engineering team leader.
- Preferred experience with the full software development lifecycle, including coding standards, code reviews, source control, build processes, testing, and operations.
- Preferred bachelor's degree in computer science or equivalent.
- Experience with machine learning and LLM fundamentals, including architecture, training and inference lifecycles, and model execution optimization.
- Experience building real-time, low-latency ML or LLM inference systems at scale and deploying models in production on GPUs, Neuron, TPU, or other AI acceleration hardware.
- Experience building and operating large-scale distributed services handling billions of requests per day.
Benefits
- Comprehensive medical, dental, vision, prescription, life, and AD&D insurance options.
- Employee assistance program, mental health support, medical advice line, flexible spending accounts, and adoption and surrogacy reimbursement.
- 401(k) matching, paid time off, and parental leave.
- Additional compensation may include sign-on payments and restricted stock units.
- Position is based in Seattle, Washington, USA.
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.