19 days ago
Base Salary
$120k - $261k/yr
Responsibilities
- Develop across AI software abstractions, programming models, compilers, runtimes, libraries, and APIs for large-scale model training and inference.
- Benchmark OpenAI and other LLMs on GPUs and Microsoft hardware.
- Debug, profile, and optimize CPU/GPU performance for training and inference workloads.
- Monitor performance regressions and drive improvements that reduce deployment time and hardware footprint.
- Collaborate with researchers and engineers to deliver scalable, production-ready AI performance improvements.
- Independently lead projects.
Requirements
- Bachelor's degree in computer science or a related technical field and 4+ years of technical engineering experience, including coding in C++ or Python, or equivalent experience.
- Preferred qualifications include a master's degree and 6+ years of experience, or a bachelor's degree and 8+ years of experience, or equivalent experience.
- At least 4 years of practical experience with high-performance applications and performance debugging and optimization on CPUs and GPUs.
- Experience with DNN/LLM inference and one or more deep learning frameworks such as PyTorch, TensorFlow, or ONNX Runtime.
- Familiarity with CUDA, ROCm, and Triton.
- Strong foundations in software engineering, computer architecture, GPU architecture, and hardware neural-network acceleration.
- Experience analyzing and optimizing the performance of LLMs and HPC applications, including use of GPU profiling tools.
- Ability to collaborate across research and development teams and independently lead projects.
- Ability to meet Microsoft, customer, and government security screening requirements, including the Microsoft Cloud background check.
Benefits
- The typical U.S. base pay range is USD $119,800-$234,700 per year, with a San Francisco Bay Area and New York City metropolitan area range of USD $160,200-$261,000 per year.
- Certain roles may be eligible for benefits and other compensation.
- The position is open for at least five days and accepts applications on an ongoing basis until filled.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.