13 hours ago
Base Salary
$120k - $261k/yr
Responsibilities
- Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
- Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
- Build automation and observability to detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding.
- Drive projects from problem definition through deployment while balancing delivery speed, maintainability, reliability, and measurable impact.
- Partner with researchers, model teams, infrastructure owners, and hardware vendors to diagnose cross-stack issues and deliver production-ready solutions.
- Contribute to technical design reviews, engineering standards, operational health, and mentoring other engineers.
Requirements
- Bachelor’s degree in computer science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++ or Python, or equivalent experience.
- Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
- Preferred: expertise in GPU or equivalent accelerator programming and kernel optimization using CUDA, Triton, or comparable technologies.
- Preferred: experience using profiling and benchmarking to deliver measurable performance improvements, with knowledge of memory hierarchy, parallel execution, synchronization, and hardware utilization.
- Preferred: familiarity with vLLM, SGLang, or equivalent inference frameworks, including model execution, scheduling, batching, and KV-cache mechanisms.
- Preferred: demonstrated technical ownership, cross-team collaboration, and independent delivery of complex production engineering changes.
- Preferred: ability to use AI-assisted development tools effectively while maintaining engineering judgment and accountability for correctness, performance, and maintainability.
Benefits
- The typical U.S. base pay range is USD $119,800–$234,700 per year, with a separate San Francisco Bay Area and New York City metropolitan area range of USD $160,200–$261,000 per year.
- Certain roles may be eligible for benefits and other compensation.
- The position is open for at least five days, with applications accepted on an ongoing basis until filled.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.