Amazon

Software Development Engineer, AI Runtime

Amazon
Apply
16 days ago
Pune, IndiaMid Level

Responsibilities

  • Design, build, and operate large-scale distributed services for Alexa+ expert executions.
  • Develop and optimize LLM orchestration pipelines, including model serving, prompt routing, and inference optimization.
  • Build multi-agent coordination systems that route requests to expert agents with minimal latency.
  • Own the operational excellence and 99.99%+ availability of Tier-1 services.
  • Collaborate with applied scientists and ML engineers to integrate AI capabilities into production.
  • Drive architecture decisions balancing performance, reliability, and cost efficiency.
  • Mentor teammates and provide technical leadership through code reviews and design reviews.

Requirements

  • At least 3 years of non-internship professional software development experience.
  • At least 2 years of non-internship experience designing or architecting new and existing systems, including design patterns, reliability, and scaling.
  • Bachelor’s degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
  • Experience programming in at least one software programming language.
  • Preferred: at least 3 years of full software development life-cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
  • Preferred: bachelor’s degree in computer science or equivalent.
  • Preferred: experience with system design involving AI components and evaluating latency, cost, reliability, and accuracy.
Amazon

About Amazon

10,000+ employees

Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.

Contact me