Amazon

Software Development Engineer, AI Runtime

Amazon
Apply
17 hours ago
Pune, IndiaMid Level

Responsibilities

  • Design, build, and operate large-scale distributed services powering Alexa+ expert executions.
  • Develop and optimize LLM orchestration pipelines, including model serving, prompt routing, and inference optimization.
  • Build multi-agent coordination systems that route requests to appropriate expert agents with minimal latency.
  • Own operational excellence for Tier-1 services targeting 99.99%+ availability at scale.
  • Collaborate with applied scientists and ML engineers to integrate AI capabilities into production.
  • Drive architecture decisions balancing performance, reliability, and cost efficiency.
  • Mentor teammates and provide technical leadership through code reviews and design reviews.

Requirements

  • At least 3 years of non-internship professional software development experience.
  • At least 2 years of non-internship experience designing or architecting new and existing systems, including design patterns, reliability, and scaling.
  • Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
  • Experience programming in at least one software programming language.
  • Preferred: at least 3 years of full software development lifecycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
  • Preferred: bachelor's degree in computer science or equivalent.
  • Preferred: system design experience with AI components and evaluating latency, cost, reliability, and accuracy.
Amazon

About Amazon

10,000+ employees

Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.

Contact me