20 hours ago
Base Salary
$120k - $261k/yr
Responsibilities
- Design and implement core inference infrastructure for serving frontier AI models in production.
- Drive performance and efficiency improvements for large language and generative AI models.
- Design efficient workload-aware load scheduling and balancing strategies.
- Scale the platform to meet increasing demand while maintaining high availability.
- Deliver capabilities for new generative AI models, including GPT-5, realtime audio, and Sora.
- Develop generic platform features for customers including GitHub, Microsoft 365, Microsoft AI, and third-party companies.
- Collaborate with internal and external partners and embody Microsoft’s culture and values.
Requirements
- Bachelor’s degree in computer science or a related technical field and 4+ years of technical engineering experience coding in languages including C, C++, C#, or Java, or equivalent experience.
- Technical foundation in software engineering principles, distributed computing, and architecture.
- Experience with high-scale, reliable online systems and low-latency, high-throughput real-time services.
- Experience working with L7 network proxies and gateways.
- Knowledge of network architecture and concepts, including HTTP, TCP, authentication, and sessions.
- Experience with OSS, Docker, Kubernetes, C++, Golang, or equivalent programming languages.
- Ability to meet Microsoft, customer, and government security screening requirements, including the Microsoft Cloud Background Check.
- Strong cross-team collaboration skills and willingness to work with researchers and developers.
Benefits
- The typical U.S. base pay range is USD $119,800-$234,700 per year; specific ranges apply in the San Francisco Bay Area and New York City metropolitan area.
- Certain roles may be eligible for benefits and other compensation.
- The position is open for a minimum of five days, with applications accepted on an ongoing basis until filled.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.