26 days ago
Base Salary
$143k - $304k/yr
Responsibilities
- Develop AI workload management, scheduling, preemption, failover, and serving systems.
- Design and build GPU-accelerated infrastructure for training and inference across bare metal, virtual machines, and containers.
- Build orchestration and resource governance capabilities using AKS and the Kubernetes ecosystem for fair sharing, isolation, and efficient accelerated-resource utilization.
- Design, develop, test, and maintain C# and Go services hosted on Kubernetes clusters.
- Optimize performance, reliability, and utilization across large GPU fleets and scale-up and scale-out configurations.
- Deliver platform features through production, including observability, diagnostics, and operational excellence.
- Influence platform architecture and technical direction through design reviews and technical leadership.
- Mentor engineers and drive cross-team architectural alignment.
Requirements
- Bachelor's degree in computer science or a related technical field and 6+ years of technical engineering experience, or equivalent experience.
- Coding experience in languages including C, C++, C#, Java, JavaScript, Linux, Go, or Python.
- Ability to meet Microsoft, customer, and government security screening requirements, including the Microsoft Cloud Background Check.
- Experience designing and operating large-scale production infrastructure with high reliability and performance requirements.
- Experience with resource scheduling, preemption, and priority handling on large clusters.
- Experience with large-scale online inference services and multitenant AI platforms in cloud environments.
- Familiarity with inference or distributed training stacks, NCCL-style collectives, model/data parallelism, and large language models.
- Familiarity with GPU-accelerated computing, including CUDA, GPU drivers, device plugins, or runtime integration.
- DevOps experience with microservices architecture in complex infrastructure and operational environments.
- Preferred qualifications include a master's degree and 8+ years of experience, or a bachelor's degree and 12+ years of experience, or equivalent experience.
- Demonstrated problem-solving, complex cross-layer debugging, collaboration, communication, and technical leadership skills.
Benefits
- Certain roles may be eligible for benefits and other compensation.
- The position is open for a minimum of five days, with applications accepted on an ongoing basis until filled.
Tech Stack
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.