Microsoft

Principal Software Engineer, AI Infra Management and Ops

Microsoft
Apply
1 day ago
Remote, United StatesStaff+
H1B sponsor

Base Salary

$120k - $304k/yr

Responsibilities

  • Lead the design, development, and evolution of cloud-native services, distributed systems, and platform capabilities for large-scale production environments.
  • Define technical direction and architecture across infrastructure, cloud services, networking, storage, compute, and operational excellence initiatives.
  • Develop platform capabilities for deployment automation, service lifecycle management, observability, reliability, scalability, and developer productivity.
  • Advance engineering practices involving CI/CD, infrastructure as code, testing, security, monitoring, and operational readiness.
  • Design and operate AI infrastructure, HPC platforms, bare-metal infrastructure, GPU environments, and large-scale distributed computing systems.
  • Collaborate on datacenter architecture and networking solutions involving rack-scale systems, network topologies, Ethernet fabrics, InfiniBand fabrics, RDMA, SmartNICs, DPUs, and accelerated computing platforms.
  • Provide architecture collaboration, mentorship, knowledge sharing, design review participation, and broader engineering leadership.

Requirements

  • Bachelor's degree in computer science or a related technical field and 6 or more years of technical engineering experience with coding, or equivalent experience.
  • Coding experience in languages including C, C++, C#, Java, JavaScript, or Python.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including Microsoft's Cloud background check upon hire or transfer and every two years thereafter.
  • Experience delivering technical solutions across multiple engineering teams, organizations, or business areas is preferred.
  • Architectural leadership, technical mentoring, cross-organizational collaboration, and the ability to simplify complex technical challenges are preferred.
  • Knowledge of large-scale distributed systems, cloud-native platforms, infrastructure services, AI infrastructure, HPC, accelerated computing, GPU deployments, datacenter architecture, or modern datacenter networking is preferred.
  • Familiarity with InfiniBand, NVLink, NVSwitch, Ethernet, RDMA, SmartNICs, DPUs, bare-metal infrastructure, hardware lifecycle management, fleet operations, infrastructure telemetry, or platform operations is preferred.
  • Proficiency in one or more modern programming languages such as Go, Rust, C#, Java, or Python is preferred.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me