22 hours ago
Base Salary
$120k - $261k/yr
Responsibilities
- Work across abstractions, programming models, compilers, runtimes, libraries, and APIs to enable large-scale model training and inference.
- Benchmark OpenAI and other LLMs on GPUs and Microsoft hardware.
- Debug, profile, and optimize training and inference workloads on CPUs and GPUs.
- Monitor performance regressions and drive improvements that reduce time to deployment and hardware footprint.
- Collaborate with researchers and engineers to deliver scalable, production-ready AI performance improvements.
- Independently lead projects.
Requirements
- Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in C++ or Python, or equivalent experience.
- Preferred qualifications include a master's degree with 6+ years of technical engineering experience, or a bachelor's degree with 8+ years of experience, or equivalent experience.
- At least 4 years of practical experience with high-performance applications, performance debugging, and optimization on CPUs and GPUs.
- Experience with DNN/LLM inference and one or more deep learning frameworks such as PyTorch, TensorFlow, or ONNX Runtime.
- Familiarity with CUDA, ROCm, and Triton.
- Strong foundations in software engineering, computer architecture, GPU architecture, and hardware neural-network acceleration.
- Experience analyzing and optimizing the end-to-end performance of state-of-the-art LLMs and HPC applications, including GPU profiling tools.
- Ability to collaborate across teams and independently lead projects.
- Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud background check.
Benefits
- The typical U.S. base pay range is USD $119,800-$234,700 per year; a separate range applies to specified San Francisco Bay Area and New York City metropolitan area locations.
- Certain roles may be eligible for benefits and other compensation.
- The position is open for at least 5 days and accepts applications on an ongoing basis until filled.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.