Microsoft

Principal Software Engineer, AI Infrastructure

Microsoft
Apply
21 hours ago
Redmond, WA, USAStaff+
H1B sponsor

Base Salary

$143k - $304k/yr

Responsibilities

  • Own the overall design of AI traffic routing, prioritization, and computing-capacity management across regions.
  • Write and review secure, well-tested code for routing, prioritization, and capacity planning.
  • Guide design reviews and establish reusable coding practices.
  • Partner with product and program managers to execute a long-term roadmap through feature flags, gradual rollouts, impact measurement, and rollback procedures.
  • Participate in the on-call rotation as a designated responsible individual for critical AI services.
  • Lead incident reviews and improve monitoring, supportability, and service reliability.
  • Partner with product, research, and infrastructure teams to prepare new AI models and capabilities for launch.
  • Support security, privacy, compliance, threat modeling, and safe deployment practices.
  • Mentor engineers and promote the use of AI tools and agents across the software development lifecycle.

Requirements

  • Bachelor’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience building distributed systems with C#, Java, Go, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Preferred: Master’s degree with 8+ years of experience, or bachelor’s degree with 12+ years of experience, or equivalent experience.
  • Preferred: 5+ years running distributed services on Microsoft Azure, Amazon Web Services, or Google Cloud Platform.
  • Preferred: 3+ years working with systems that route or schedule traffic or use optimization methods to allocate computing resources.
  • Preferred: experience with Python, Docker, and Kubernetes.
  • Preferred: experience with AI or machine learning infrastructure, including production model serving or GPU fleet management.
  • Preferred: experience leading projects across at least three partner teams from design through launch and operation.
  • Preferred: experience supporting highly available services on call and reducing incidents measurably.

Benefits

  • Typical U.S. base pay range is $142,800–$274,800 per year, with a separate San Francisco Bay Area and New York City metropolitan area range of $188,000–$304,200 per year.
  • Certain roles may be eligible for benefits and other compensation.
  • The position is open for a minimum of five days, with applications accepted on an ongoing basis until filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me