Microsoft

Principal Software Engineer - AI Frameworks

Microsoft
Apply
15 days ago
Remote, United StatesStaff+
H1B sponsor

Base Salary

$166k - $331k/yr

Responsibilities

  • Own the technical vision, architecture, roadmap, and multi-release execution strategy for AI framework, performance, benchmarking, and developer-productivity capabilities.
  • Lead cross-team technical alignment, resolve competing requirements, and drive researchers, product groups, infrastructure owners, and hardware partners toward measurable outcomes.
  • Mentor engineers, develop technical leads, establish quality and maintainability standards, and build an inclusive engineering culture.
  • Lead ambiguous cross-stack investigations spanning models, frameworks, compilers, runtimes, systems, services, and silicon.
  • Provide hands-on technical leadership through prototypes, critical-path implementation, design and code reviews, complex debugging, and operational readiness.
  • Develop common measurement, automation, and observability mechanisms that turn analyses into scalable platform capabilities.
  • Improve model onboarding velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.

Requirements

  • Bachelor’s degree in Computer Science or a related technical field and 8+ years of technical engineering experience coding in languages such as C++ or Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Preferred: master’s degree with 12+ years of technical engineering experience, or bachelor’s degree with 15+ years of technical engineering experience, or equivalent experience.
  • Experience leading complex cross-team initiatives, setting strategy, making architectural decisions, aligning stakeholders, and driving execution through production.
  • Extensive experience designing and shipping complex, high-performance, or distributed software systems.
  • Deep knowledge of software architecture, computer architecture, and accelerator-aware optimization.
  • Advanced experience with LLM inference frameworks or AI accelerator kernel optimizations.
  • Experience creating reusable platforms, influencing senior technical and business stakeholders, developing technical leaders, and scaling engineering practices across teams.

Benefits

  • The typical U.S. base pay range is USD $165,600–$296,400 per year; a separate range applies to the San Francisco Bay Area and New York City metropolitan area.
  • Certain roles may be eligible for benefits and other compensation.
  • The position will remain open for at least five days and accepts applications on an ongoing basis until filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me