16 days ago
Remote, United States or Redmond, WA, USASenior / Staff+
H1B sponsor
Base Salary
$120k - $304k/yr
Responsibilities
- Develop and optimize GPU kernels and runtime components for LLM serving.
- Profile workloads and improve latency, throughput, and hardware efficiency.
- Integrate maintainable performance optimizations into production serving systems.
- Drive cross-stack optimization across kernels, compilers, runtimes, and distributed serving.
- Collaborate with model, research, infrastructure, compiler, and hardware teams.
- Turn performance innovations into reusable production capabilities.
- Mentor engineers, contribute to technical reviews and engineering standards, and use AI-assisted development tools effectively.
Requirements
- Bachelor’s degree in computer science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++ or Python, or equivalent experience.
- Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
- Senior-level candidates should have expertise in GPU or equivalent accelerator programming and kernel optimization, familiarity with vLLM, SGLang, or equivalent LLM inference libraries, and demonstrated technical ownership.
- Principal-level candidates should have deep expertise in accelerator compilation pipelines and low-level architecture, LLM training and inference parallelism, cross-team technical initiative ownership, reusable platform development, stakeholder influence, and technical leadership mentoring.
Benefits
- Certain roles may be eligible for benefits and other compensation.
- The position is open for a minimum of 5 days, with applications accepted on an ongoing basis until filled.
- Base pay ranges vary by role level and work location, including distinct ranges for the San Francisco Bay Area and New York City metropolitan area.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.