Microsoft

Senior and/or Principal Software Engineer - AI Frameworks

Microsoft
Apply
1 day ago
Remote, United StatesSenior / Staff+
H1B sponsor

Base Salary

$143k - $331k/yr

Responsibilities

  • Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
  • Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
  • Build automation and observability to detect regressions, improve reproducibility, surface insights, and accelerate model and hardware onboarding.
  • Drive projects from problem definition through deployment with attention to maintainability, reliability, and measurable impact.
  • Partner with researchers, model teams, infrastructure owners, hardware vendors, and production services to diagnose cross-stack issues.
  • Define technical vision, architecture, and multi-release strategy for critical AI framework, performance, benchmarking, and developer-productivity capabilities.
  • Lead cross-team technical initiatives, provide hands-on technical leadership, and mentor engineers and technical leaders.

Requirements

  • Bachelor’s degree in computer science or a related technical field and 4+ years of technical engineering experience coding in C++, Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Experience building and operating complex software systems is preferred.
  • Practical knowledge of performance analysis, benchmarking, automation, or developer tooling is preferred.
  • Familiarity with AI/ML frameworks such as PyTorch, TensorFlow, or ONNX Runtime is preferred.
  • Familiarity with GPU software and profiling technologies such as CUDA, ROCm, or Triton is preferred.
  • Principal-level candidates should have extensive experience designing and shipping complex, high-performance, or distributed software systems.
  • Principal-level candidates should have experience with software architecture, computer architecture, accelerator-aware optimization, cross-team technical initiatives, reusable platforms, stakeholder influence, and mentoring technical leaders.

Tech Stack

Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me