10 days ago
Base Salary
$143k - $304k/yr
Responsibilities
- Design and implement complex inference capabilities for state-of-the-art deep learning models and AI infrastructure.
- Build robust, extensible frameworks supporting both experimentation and production use cases.
- Optimize GPU-based inference performance and cost using advanced hardware and software techniques.
- Collaborate with internal and external teams to improve model performance and deployment and translate ideas into production.
- Develop tools for experiment tracking, model versioning, and performance monitoring across the AI lifecycle.
- Provide technical leadership, mentor early-in-career engineers, and support an inclusive team environment.
Requirements
- Bachelor’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience with coding, or equivalent experience.
- Proficiency with one or more of C, C++, C#, Java, JavaScript, or Python.
- Ability to meet Microsoft, customer, and government security screening requirements, including the Microsoft Cloud Background Check.
- Preferred: master’s degree with 8+ years of experience, or bachelor’s degree with 12+ years of experience, or equivalent experience.
- Preferred: 2+ years of experience with deep learning frameworks such as PyTorch, ONNX Runtime, TensorFlow, vLLM, or TensorRT-LLM.
- Preferred: end-to-end system design and development experience and familiarity with MLOps.
- Preferred: experience with low-level GPU architecture, optimization, kernel programming, and model quantization.
- Preferred: knowledge of Docker, Kubernetes, high-performance application development, technical leadership, and mentoring.
Benefits
- Employees within the stated commuting distance of a designated Microsoft office are expected to work from the office at least four days per week beginning January 26, 2026, subject to local law and jurisdiction.
- Certain roles may be eligible for benefits and other compensation.
Tech Stack
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.