Base Salary
$143k - $304k/yr
Responsibilities
- Design and implement complex inference capabilities for deep learning models.
- Build robust, extensible frameworks supporting experimentation and production use cases.
- Optimize GPU inference performance and cost using advanced hardware and software stacks.
- Collaborate with internal and external teams to improve model performance and deployment.
- Develop tools for experiment tracking, model versioning, and performance monitoring across the AI lifecycle.
- Identify impactful technical problems, advance AI infrastructure technologies, and translate innovations into production.
- Foster an inclusive environment and support representation, retention, and growth within the team.
Requirements
- Bachelor’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience with coding, or equivalent experience.
- Coding experience in languages including C, C++, C#, Java, JavaScript, or Python.
- Ability to meet Microsoft, customer, and government security screening requirements, including the Microsoft Cloud Background Check.
- Preferred: master’s degree with 8+ years of experience, or bachelor’s degree with 12+ years of experience, or equivalent experience.
- Preferred: 2+ years of experience with deep learning frameworks such as PyTorch, OnnxRuntime, TensorFlow, vLLM, or TensorRT-LLM.
- Experience with end-to-end system design and development and familiarity with MLOps.
- Experience with low-level GPU architecture, optimization, kernel programming, and model quantization.
- Knowledge of Docker, Kubernetes, and high-performance application development.
- Technical leadership skills and ability to mentor early-in-profession engineers.
Benefits
- The typical U.S. base pay range is $142,800–$274,800 per year, with a separate range for the San Francisco Bay Area and New York City metropolitan area.
- Employees within the stated commuting distance of designated offices are expected to work onsite at least four days per week starting January 26, 2026, subject to local law and jurisdiction.
- Certain roles may be eligible for benefits and other compensation.
- The position will be open for at least five days, with applications accepted on an ongoing basis until filled.
Tech Stack
Categories
About Microsoft
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting in differences. Because impact matters. Microsoft operates in 190 countries and is made up of approximately 228,000 passionate employees worldwide.