Microsoft

Principal Software Engineer - AI Infrastructure

Microsoft
Apply
14 hours ago
Redmond, WA, USA or Mountain View, CA, USAStaff+
H1B sponsor

Base Salary

$143k - $304k/yr

Responsibilities

  • Define and drive the architecture and technical roadmap for platform reliability, observability, and operational health.
  • Design unified health and telemetry capabilities connecting customer impact with application, capacity, dependency, infrastructure, and deployment signals.
  • Develop safeguards for overload protection, capacity management, routing integrity, configuration consistency, automated isolation, and recovery.
  • Establish practices for production validation, progressive delivery, regression detection, fault testing, and automated rollback.
  • Advance end-to-end request tracing and diagnostics across distributed services, including routing, retries, failover, and asynchronous operations.
  • Lead cross-team architecture efforts, mentor engineers, and turn production learnings into reusable platform capabilities and measurable reliability improvements.

Requirements

  • Bachelor’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience with coding, or equivalent experience.
  • Preferred qualifications include a master’s degree and 8+ years of experience, or a bachelor’s degree and 12+ years of experience, or equivalent experience.
  • Experience with AI/ML serving platforms, high-performance computing, accelerator-based infrastructure, or compute-intensive distributed systems.
  • Experience with distributed tracing, capacity management, load balancing, admission control, retries, backpressure, and graceful degradation.
  • Experience designing, building, and operating large-scale distributed systems, cloud services, or complex production platforms.
  • Experience with reliability engineering, observability, service health, telemetry, and production incident response.
  • Ability to lead complex technical initiatives and align engineering teams across organizational boundaries.
  • Strong written and verbal communication skills for explaining technical strategy and architectural decisions.
  • Ability to meet Microsoft, customer, and government security screening requirements, including the Microsoft Cloud Background Check.

Categories

DevOpsSite Reliability
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me