8 hours ago
Base Salary
$143k - $331k/yr
Responsibilities
- Work across AI software stack layers including abstractions, programming models, compilers, runtimes, libraries, and APIs.
- Benchmark OpenAI and other LLMs on GPUs and Microsoft hardware.
- Debug, profile, and optimize training and inference workloads on CPUs and GPUs.
- Monitor performance regressions and drive improvements that reduce deployment time and hardware footprint.
- Collaborate with researchers and engineers to deliver scalable, production-ready AI performance improvements.
- Independently lead projects.
Requirements
- Bachelor’s degree in Computer Science or a related technical field plus 6+ years of technical engineering experience, including coding in C++ or Python, or equivalent experience.
- Preferred qualifications include a master’s degree plus 12+ years of experience, or a bachelor’s degree plus 15+ years of experience, or equivalent experience.
- At least 4 years of practical experience with high-performance applications and performance debugging and optimization on CPUs or GPUs is preferred.
- Experience with DNN or LLM inference and one or more of PyTorch, TensorFlow, or ONNX Runtime is preferred.
- Familiarity with CUDA, ROCm, Triton, GPU architecture, computer architecture, and hardware neural-net acceleration is preferred.
- Experience analyzing and optimizing state-of-the-art LLMs and HPC applications, including use of GPU profiling tools, is preferred.
- Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud background check.
- Strong collaboration skills and the ability to independently lead projects.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.