13 hours ago
Base Salary
$143k - $304k/yr
Responsibilities
- Define technical vision, architecture, and multi-release strategy for AI framework, performance, benchmarking, and developer-productivity capabilities.
- Lead ambiguous cross-stack investigations spanning models, frameworks, compilers, runtimes, systems, services, and silicon.
- Create scalable measurement, automation, observability, and engineering mechanisms from one-off analyses.
- Improve model onboarding velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.
- Align researchers, product groups, infrastructure owners, and hardware partners around architecture, priorities, and execution plans.
- Provide hands-on leadership through prototypes, implementation, design and code reviews, complex debugging, and operational readiness.
- Mentor junior engineers, develop technical leaders, and advance engineering quality and maintainability standards.
Requirements
- Bachelor’s degree in computer science or a related technical field and 6+ years of technical engineering experience coding in C++ or Python, or equivalent experience.
- Ability to meet Microsoft, customer, and government security screening requirements, including the Microsoft Cloud background check.
- Preferred: deep expertise in GPU or equivalent accelerator programming, compilation, low-level execution, intermediate representations, lowering, code generation, instruction-level behavior, memory hierarchy, and synchronization.
- Preferred: expertise in tensor, pipeline, data, and expert parallelism for LLM training and inference.
- Preferred: expertise in distributed inference acceleration, including prefill/decode disaggregation, KV-cache transfer, collective communication, and compute/communication overlap.
- Preferred: strong understanding of LLM serving architectures such as vLLM and SGLang.
- Preferred: demonstrated leadership of cross-team technical initiatives through strategy, design, implementation, deployment, and production impact.
- Preferred: experience creating reusable platforms, influencing stakeholders, mentoring engineers, and using AI-assisted development tools effectively.
Benefits
- Base pay is listed for U.S. locations, with a separate range for the San Francisco Bay Area and New York City metropolitan area.
- Certain roles may be eligible for benefits and other compensation.
- The position is open for a minimum of 5 days, with applications accepted on an ongoing basis until filled.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.