Microsoft

Senior and/or Principal Software Engineer - AI Frameworks

Microsoft
Apply
17 days ago
Remote, United StatesSenior / Staff+
H1B sponsor

Base Salary

$143k - $331k/yr

Responsibilities

  • Design, implement, test, and operate production components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
  • Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
  • Build automation and observability to detect regressions, improve reproducibility, surface insights, and accelerate model and hardware onboarding.
  • Drive projects from problem definition through deployment with attention to maintainability, reliability, and measurable impact.
  • Partner with researchers, model teams, infrastructure owners, hardware vendors, and production services to resolve cross-stack issues.
  • For Principal-level scope, define technical vision and architecture, lead ambiguous cross-team initiatives, establish reusable engineering mechanisms, and provide hands-on technical leadership.
  • Mentor engineers, develop technical leaders, and advance engineering standards and operational readiness.

Requirements

  • Bachelor’s degree in computer science or a related technical field and 4+ years of technical engineering experience coding in C++, Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Experience building and operating complex software systems is preferred.
  • Practical knowledge of performance analysis, benchmarking, automation, or developer tooling is preferred.
  • Familiarity with PyTorch, TensorFlow, ONNX Runtime, CUDA, ROCm, or Triton is preferred.
  • Principal-level candidates should have extensive experience with complex high-performance or distributed systems, software and computer architecture, accelerator-aware optimization, cross-team technical initiatives, reusable platforms, and mentoring technical leaders.

Benefits

  • Base pay is listed by level and location, with additional benefits and other compensation potentially available.
  • Applications are accepted on an ongoing basis until the position is filled, with the posting open for a minimum of five days.

Tech Stack

Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me