Microsoft

Principal Software Engineer - AI Frameworks

Microsoft
Apply
1 day ago
Remote, United StatesStaff+
H1B sponsor

Base Salary

$166k - $331k/yr

Responsibilities

  • Own the technical vision, architecture, roadmap, and multi-release execution strategy for critical AI framework, performance, benchmarking, and developer-productivity capabilities.
  • Lead technical alignment across researchers, product groups, infrastructure owners, hardware partners, and engineering teams.
  • Mentor engineers, develop emerging technical leads, and establish quality, maintainability, and inclusive engineering standards.
  • Lead cross-stack investigations spanning models, frameworks, compilers, runtimes, systems, services, and silicon.
  • Provide hands-on leadership through prototypes, critical-path implementation, design and code reviews, complex debugging, and operational readiness.
  • Build measurement, automation, observability, and engineering mechanisms that scale platform capabilities.
  • Drive measurable improvements in model onboarding velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.

Requirements

  • Bachelor’s degree in computer science or a related technical field and 8+ years of technical engineering experience coding in C++ or Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Preferred: master’s degree and 12+ years of technical engineering experience, or bachelor’s degree and 15+ years of technical engineering experience, or equivalent experience.
  • Experience leading complex cross-team initiatives from strategy and architecture through production execution.
  • Extensive experience designing and shipping complex, high-performance, or distributed software systems.
  • Strong foundations in software architecture, computer architecture, and accelerator-aware optimization.
  • Advanced experience with LLM inference frameworks or AI accelerator kernel optimizations.
  • Experience creating reusable platforms, influencing senior stakeholders, developing technical leaders, and scaling engineering practices across teams.

Benefits

  • The typical U.S. base pay range is USD $165,600-$296,400 per year; a separate range applies in the San Francisco Bay Area and New York City metropolitan area.
  • Certain roles may be eligible for benefits and other compensation.
  • The position will remain open for at least 5 days and accept applications on an ongoing basis until filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me