Base Salary
$120k - $304k/yr
Responsibilities
- Identify and drive improvements to end-to-end inference performance for OpenAI and other large language models.
- Benchmark models on NVIDIA and AMD GPUs and Microsoft first-party silicon.
- Optimize and monitor LLM performance and build software tooling for performance analysis from the model level through systems and silicon.
- Develop tools that accelerate porting and deploying models on new NVIDIA and AMD GPUs.
- Design, implement, and test components for AI, DNN, and LLM frameworks and tools.
- Reduce the complexity and improve the performance and efficiency of key system components and pipelines.
- Collaborate with internal and external partners on AI performance and deployment initiatives.
Requirements
- Bachelor’s degree in computer science or a related technical field and 4+ years of technical engineering experience with coding, or equivalent experience.
- Experience coding in languages including C, C++, C#, Java, JavaScript, or Python.
- Ability to pass required Microsoft, customer, and/or government security screenings, including the Microsoft Cloud Background Check.
- Preferred: master’s degree and 8+ years of technical engineering experience, or bachelor’s degree and 12+ years of experience, or equivalent experience.
- Preferred: foundation in software engineering, computer architecture, GPU architecture, and hardware neural-network acceleration.
- Preferred: experience with end-to-end LLM performance analysis and optimization and GPU profiling tools.
- Preferred: experience with DNN/LLM inference and one or more deep-learning frameworks such as PyTorch, TensorFlow, or ONNX Runtime, plus familiarity with CUDA, ROCm, or Triton.
- Preferred: ability to collaborate across teams of researchers and developers.
Benefits
- The role is eligible for Microsoft benefits and other compensation as applicable.
- The position requires passing a Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.
- Applications are accepted on an ongoing basis until the position is filled, with the position open for at least five days.
Categories
About Microsoft
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting in differences. Because impact matters. Microsoft operates in 190 countries and is made up of approximately 228,000 passionate employees worldwide.