16 hours ago
Remote, United States or Redmond, WA, USASenior / Staff+
H1B sponsor
Base Salary
$120k - $304k/yr
Responsibilities
- Develop and optimize GPU kernels and runtime components for LLM serving.
- Profile workloads and improve latency, throughput, reliability, and hardware efficiency.
- Integrate maintainable optimizations into production serving systems.
- Lead cross-stack optimization across kernels, compilers, runtimes, and distributed inference systems at the Principal level.
- Collaborate with model, compiler, infrastructure, research, and hardware teams.
- Create reusable performance capabilities and resolve critical low-level bottlenecks.
- Contribute to technical reviews, engineering standards, mentoring, and effective use of AI-assisted development tools.
Requirements
- Bachelor’s degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in C++ or Python, or equivalent experience.
- Ability to pass Microsoft Cloud Background Check and meet applicable Microsoft, customer, and/or government security screening requirements.
- Senior-level candidates should have expertise in GPU or accelerator programming and kernel optimization, familiarity with vLLM, SGLang, or equivalent LLM inference libraries, and demonstrated technical ownership.
- Principal-level candidates should have deep expertise in accelerator compilation pipelines and low-level architecture, LLM training and inference parallelism, cross-team technical initiatives, reusable platforms, senior stakeholder influence, and technical leadership mentoring.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.