16 hours ago
Remote, United StatesSenior / Staff+
H1B sponsor
Base Salary
$120k - $304k/yr
Responsibilities
- Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
- Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
- Build automation and observability to detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding.
- Drive projects from problem definition through deployment while balancing delivery speed, maintainability, reliability, and measurable customer or capacity impact.
- Partner with researchers, model teams, infrastructure owners, hardware vendors, and production services to diagnose cross-stack issues and deliver production-ready solutions.
- Define technical vision, architecture, and multi-release strategy for critical AI framework, performance, benchmarking, and developer-productivity capabilities at the Principal level.
- Lead cross-team technical initiatives through prototypes, implementation, design and code reviews, complex debugging, operational readiness, and mentoring.
Requirements
- Bachelor’s degree in computer science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++ or Python, or equivalent experience.
- Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
- Experience building and operating complex software systems.
- Practical knowledge of performance analysis, benchmarking, automation, or developer tooling.
- Familiarity with AI/ML frameworks such as PyTorch, TensorFlow, or ONNX Runtime.
- Familiarity with GPU software and profiling technologies such as CUDA, ROCm, or Triton.
- Familiarity with runtimes, collective operations, and networking concepts.
- For Principal roles, extensive experience designing and shipping complex, high-performance, or distributed software systems is preferred.
- For Principal roles, experience with software architecture, computer architecture, accelerator-aware optimization, cross-team technical leadership, reusable platforms, senior-stakeholder influence, and mentoring technical leaders is preferred.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.