Microsoft

Principal Software Engineer - Compute Graph Compiler

Microsoft
Apply
2 days ago
Remote, United States or Redmond, WA, USAStaff+
H1B sponsor

Base Salary

$143k - $304k/yr

Responsibilities

  • Define and drive the technical vision, architecture, and roadmap for Windows ML compiler stack components.
  • Lead cross-team initiatives to improve AI workload performance, scalability, and efficiency across CPU, GPU, and NPU hardware.
  • Drive NPU enablement strategy and advanced optimization techniques for next-generation AI processors.
  • Partner with hardware vendors and internal platform teams to influence future AI hardware and software capabilities.
  • Design and develop high-performance compiler infrastructure, execution engines, and developer tooling.
  • Solve systems challenges involving scheduling, memory management, code generation, graph optimization, and hardware abstraction.
  • Mentor engineers and provide technical leadership across multiple projects and organizations.
  • Shape Microsoft’s long-term strategy for on-device AI and generative AI execution on Windows.

Requirements

  • Bachelor’s degree in computer science or a related technical field and 6+ years of technical engineering experience with production-quality systems software, AI/ML platforms, or related technologies, or equivalent experience.
  • Experience designing and delivering production-quality systems software, AI/ML platforms, or related technologies.
  • Hands-on experience with ML compilers, runtimes, frameworks, tools, and platform technologies.
  • Operating system development experience, including user-mode and/or kernel-mode driver development.
  • Experience designing ML accelerators or hardware microarchitecture and connecting hardware with compilers, runtimes, drivers, and frameworks.
  • Knowledge of computer architecture, heterogeneous computing, memory systems, parallel processing, and hardware/software co-design.
  • Experience optimizing ML workloads across the full software and hardware stack, including GPU optimization.
  • Technical leadership experience defining architecture and taking AI platforms or accelerators from early design and prototypes through production.

Benefits

  • The typical U.S. base pay range is USD $142,800–$274,800 per year; a separate range applies to specified San Francisco Bay Area and New York City metropolitan area locations.
  • Certain roles may be eligible for benefits and other compensation.
  • The position will remain open for a minimum of 5 days and accept applications on an ongoing basis until filled.

Tech Stack

Windows

Categories

Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me