13 hours ago
Remote, United StatesSenior / Staff+
H1B sponsor
Base Salary
$143k - $331k/yr
Responsibilities
- Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
- Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
- Build automation and observability to detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding.
- Drive projects from problem definition through deployment while balancing delivery speed, maintainability, reliability, and measurable impact.
- Partner with researchers, model teams, infrastructure owners, hardware vendors, product groups, and production services to resolve cross-stack issues.
- For Principal-level scope, define technical vision and architecture, lead multi-release initiatives, align teams, and improve model velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.
- Provide hands-on technical leadership through prototypes, implementation, design and code reviews, debugging, operational readiness, mentoring, and engineering standards.
Requirements
- Bachelor’s degree in computer science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++ or Python, or equivalent experience.
- Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud background check upon hire or transfer and every two years thereafter.
- Preferred Senior-level qualifications include experience building and operating complex software systems; performance analysis, benchmarking, automation, or developer tooling; AI/ML frameworks such as PyTorch, TensorFlow, or ONNX Runtime; and GPU software or profiling technologies such as CUDA, ROCm, or Triton.
- Preferred Principal-level qualifications include extensive experience shipping complex, high-performance, or distributed systems; software and computer architecture; accelerator-aware optimization; AI/ML workloads and frameworks; cross-team technical leadership; reusable platform creation; senior-stakeholder influence; and mentoring technical leaders.
Benefits
- Base pay is listed by level and location, with additional benefits and other compensation potentially available.
- The position will remain open for a minimum of five days and accepts applications on an ongoing basis until filled.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.