17 days ago
Remote, United StatesSenior / Staff+
H1B sponsor
Base Salary
$143k - $331k/yr
Responsibilities
- Design, implement, test, and operate production components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
- Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
- Build automation and observability to detect regressions, improve reproducibility, surface insights, and accelerate model and hardware onboarding.
- Drive projects from problem definition through deployment with attention to maintainability, reliability, and measurable impact.
- Partner with researchers, model teams, infrastructure owners, hardware vendors, and production services to resolve cross-stack issues.
- For Principal-level scope, define technical vision and architecture, lead ambiguous cross-team initiatives, establish reusable engineering mechanisms, and provide hands-on technical leadership.
- Mentor engineers, develop technical leaders, and advance engineering standards and operational readiness.
Requirements
- Bachelor’s degree in computer science or a related technical field and 4+ years of technical engineering experience coding in C++, Python, or equivalent experience.
- Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
- Experience building and operating complex software systems is preferred.
- Practical knowledge of performance analysis, benchmarking, automation, or developer tooling is preferred.
- Familiarity with PyTorch, TensorFlow, ONNX Runtime, CUDA, ROCm, or Triton is preferred.
- Principal-level candidates should have extensive experience with complex high-performance or distributed systems, software and computer architecture, accelerator-aware optimization, cross-team technical initiatives, reusable platforms, and mentoring technical leaders.
Benefits
- Base pay is listed by level and location, with additional benefits and other compensation potentially available.
- Applications are accepted on an ongoing basis until the position is filled, with the posting open for a minimum of five days.
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.
