Microsoft

Principal Software Engineer - AI Infrastructure

Microsoft
Apply
3 days ago
Redmond, WA, USA or Mountain View, CA, USAStaff+
H1B sponsor

Base Salary

$143k - $304k/yr

Responsibilities

  • Define and drive architecture and technical roadmaps for platform reliability, observability, and operational health.
  • Build unified health and telemetry capabilities connecting customer impact with application, capacity, dependency, infrastructure, and deployment signals.
  • Develop safeguards for overload protection, capacity management, routing integrity, configuration consistency, automated isolation, and recovery.
  • Establish practices for production validation, progressive delivery, regression detection, fault testing, and automated rollback.
  • Advance distributed request tracing and diagnostics across routing, retries, failover, and asynchronous operations.
  • Lead cross-team architecture efforts, mentor engineers, and convert production learnings into reusable platform capabilities and reliability improvements.

Requirements

  • Bachelor’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Preferred qualifications include a master’s degree and 8+ years of experience, or a bachelor’s degree and 12+ years of experience, or equivalent experience.
  • Experience with AI/ML serving platforms, high-performance computing, accelerator-based infrastructure, or compute-intensive distributed systems.
  • Experience with distributed tracing, capacity management, load balancing, admission control, retries, backpressure, and graceful degradation.
  • Experience designing, building, and operating large-scale distributed systems, cloud services, or complex production platforms.
  • Experience with reliability engineering, observability, service health, telemetry, and production incident response.
  • Ability to lead complex technical initiatives and align engineering teams across organizational boundaries.
  • Strong written and verbal communication skills for explaining technical strategy and architectural decisions.
  • Experience with Azure Monitoring systems in the Azure ecosystem is preferred.

Benefits

  • The typical U.S. base pay range is USD $142,800–$274,800 per year; the San Francisco Bay Area and New York City metropolitan areas have a base pay range of USD $188,000–$304,200 per year.
  • Certain roles may be eligible for benefits and other compensation.
  • The position will remain open for at least five days and accepts applications on an ongoing basis until filled.

Categories

DevOpsSite Reliability
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me