Microsoft

Software Engineer II

Microsoft
Apply
9 days ago
Redmond, WA, USAMid Level
H1B sponsor

Base Salary

$102k - $219k/yr

Responsibilities

  • Design, develop, and maintain AI infrastructure services in Go, Rust, Python, C++, and C# on large-scale Kubernetes clusters.
  • Collaborate with engineers, researchers, and external partners to troubleshoot issues and improve the reliability and performance of AI training and inference systems.
  • Build distributed systems with high reliability, low latency, operational efficiency, and strong security across Azure and partner cloud environments.
  • Develop automation and tooling to improve GPU capacity utilization, streamline fleet operations, and scale AI infrastructure efficiently.
  • Provide operational support and technical leadership while contributing to deployment, monitoring, and continuous improvement of engineering systems and practices.

Requirements

  • Bachelor’s degree in computer science or a related technical field and 2+ years of technical engineering experience with coding, or equivalent experience.
  • 2+ years of experience designing, developing, and shipping high-quality software.
  • 2+ years of experience with distributed systems and cloud-based infrastructure.
  • 1+ year of experience with DevOps practices, including deployment and automated testing.
  • 2+ years of software development experience in C#, C++, Python, or similar languages.
  • 2+ years of experience with containerization tools such as Docker and Kubernetes.
  • Knowledge and hands-on experience with production ML systems, large-scale training infrastructure, NCCL, and CUDA libraries and tools.

Benefits

  • The typical U.S. base pay range is $102,100–$202,200 per year, with a separate San Francisco Bay Area and New York City metropolitan area range of $133,800–$219,200 per year.
  • Certain roles may be eligible for benefits and other compensation.
  • The position will remain open for at least five days and accepts applications on an ongoing basis until filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me