Microsoft

Senior and/or Principal Software Engineer- AI Frameworks

Microsoft
Apply
2 days ago
Redmond, WA, USA +2 moreSenior / Staff+
H1B sponsor

Base Salary

$143k - $331k/yr

Responsibilities

  • Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
  • Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
  • Build automation and observability to detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding.
  • Drive projects from problem definition through deployment while balancing delivery speed, maintainability, reliability, and measurable impact.
  • Partner with researchers, model teams, infrastructure owners, hardware vendors, product groups, and other teams to diagnose cross-stack issues and deliver production-ready solutions.
  • Define technical vision and architecture for critical AI framework, performance, benchmarking, or developer-productivity capabilities at the Principal level.
  • Provide hands-on technical leadership through prototyping, implementation, design and code reviews, debugging, operational readiness, mentoring, and engineering standards.

Requirements

  • Bachelor’s degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++ or Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.
  • Senior-level preferred experience building and operating complex software systems and practical knowledge of performance analysis, benchmarking, automation, or developer tooling.
  • Familiarity with AI/ML frameworks such as PyTorch, TensorFlow, or ONNX Runtime.
  • Familiarity with GPU software and profiling technologies such as CUDA, ROCm, or Triton.
  • Principal-level preferred experience designing and shipping complex, high-performance, or distributed software systems.
  • Principal-level experience in software architecture, computer architecture, accelerator-aware optimization, AI/ML workloads and frameworks, cross-team technical initiatives, reusable platforms, stakeholder influence, and mentoring technical leaders.

Benefits

  • Base pay is provided in different ranges for Software Engineering IC5 and IC6 roles, with location-specific ranges for the San Francisco Bay Area and New York City metropolitan area.
  • Certain roles may be eligible for benefits and other compensation.
  • The position remains open for a minimum of five days and accepts applications on an ongoing basis until filled.

Tech Stack

Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me