Base Salary
$120k - $235k/yr
Responsibilities
- Design and implement scalable, reliable, and performant distributed systems for Azure AI traffic management and scheduling.
- Drive architecture and technical direction for routing, capacity allocation, and workload optimization services.
- Develop algorithms and control-plane systems for distributing AI workloads across global infrastructure while meeting latency, availability, and cost objectives.
- Build observability and operational tooling for service health, capacity utilization, traffic patterns, and customer impact.
- Lead production investigations and improve reliability, resiliency, automation, and fleet efficiency.
- Collaborate with partner teams to onboard models, regions, and customer offerings.
- Mentor engineers, review designs and code, and raise engineering standards.
- Influence long-term platform strategy and contribute to roadmap planning for AI infrastructure.
Requirements
- Bachelor’s degree in Computer Science or a related technical field and 4+ years of technical engineering experience with coding, or equivalent experience.
- Coding experience with languages including C, C++, C#, Java, JavaScript, or Python.
- Strong coding skills in C#, Python, or Go.
- Experience with distributed systems or cloud infrastructure, telemetry, metrics pipelines, resource scheduling, or large-scale service operations.
- Familiarity with Azure, AWS, GCP, Kubernetes, or Service Fabric.
- Experience with distributed storage systems, telemetry platforms, real-time data processing, or stringent reliability and availability requirements.
- Familiarity with AI/ML infrastructure, GPU fleets, inference serving systems, or large-scale model deployment platforms.
- Experience leading cross-team initiatives from design through production deployment and operation.
- Ability to meet Microsoft Cloud Background Check and applicable customer or government security screening requirements.
- Preferred qualifications include a master’s degree with 6+ years of experience or a bachelor’s degree with 8+ years of experience.
Benefits
- The typical U.S. base pay range is $119,800–$234,700 per year, with a separate San Francisco Bay Area and New York City metropolitan area range.
- Certain roles may be eligible for benefits and other compensation.
- The position is open for at least five days, with applications accepted on an ongoing basis until filled.
Categories
About Microsoft
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting in differences. Because impact matters. Microsoft operates in 190 countries and is made up of approximately 228,000 passionate employees worldwide.