Microsoft

Senior Software Engineer - AI Infrastructure

Microsoft
Apply
1 day ago
Redmond, WA, USA or Mountain View, CA, USASenior
H1B sponsor

Base Salary

$120k - $261k/yr

Responsibilities

  • Design and implement scalable, reliable, and performant distributed systems for Azure AI traffic management and scheduling.
  • Drive architecture and technical direction for routing, capacity allocation, and workload optimization services.
  • Develop algorithms and control-plane systems to distribute AI workloads across global infrastructure.
  • Build observability and operational tooling for service health, capacity utilization, traffic patterns, and customer impact.
  • Investigate complex production issues and improve reliability, resiliency, and platform automation.
  • Improve fleet efficiency, reduce operational overhead, and optimize premium AI infrastructure utilization.
  • Collaborate with partner teams to onboard models, regions, and customer offerings.
  • Mentor engineers, review designs and code, improve engineering standards, and contribute to roadmap planning.

Requirements

  • Bachelor's degree in computer science or a related technical field and 4+ years of technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Preferred qualifications include a master's degree with 6+ years of experience or a bachelor's degree with 8+ years of experience, or equivalent experience.
  • Experience with telemetry, metrics pipelines, resource scheduling systems, distributed storage, telemetry platforms, or real-time data processing.
  • Familiarity with Azure, AWS, GCP, Kubernetes, and Service Fabric.
  • Experience operating large-scale services with stringent reliability and availability requirements.
  • Familiarity with AI/ML infrastructure, GPU fleets, inference serving systems, or large-scale model deployment platforms.
  • Experience leading cross-team initiatives from design through production deployment and operation.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.

Benefits

  • The typical U.S. base pay range is $119,800-$234,700 per year, with a separate range for specified San Francisco Bay Area and New York City locations.
  • Certain roles may be eligible for benefits and other compensation.
  • The position is open for a minimum of 5 days, with applications accepted on an ongoing basis until filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me