Microsoft

Senior Software Engineer, AI Infra Management and Ops

Microsoft
Apply
4 days ago
Remote, United StatesSenior
H1B sponsor

Base Salary

$120k - $304k/yr

Responsibilities

  • Design, develop, and maintain cloud-native services and distributed systems supporting platform capabilities, service lifecycle management, and operational excellence at scale.
  • Define technical direction and architecture for platform infrastructure, cloud services, networking, storage, compute, and operational excellence investments across engineering organizations.
  • Develop platform engineering capabilities for deployment automation, lifecycle management, observability, reliability, scalability, and developer productivity.
  • Advance CI/CD, infrastructure as code, testing, security, monitoring, and operational readiness practices.
  • Design and operate AI infrastructure, HPC platforms, bare-metal infrastructure, GPU environments, and large-scale distributed computing systems.
  • Collaborate on datacenter architecture and networking, including rack-scale systems, network topologies, Ethernet fabrics, InfiniBand fabrics, RDMA, SmartNICs, DPUs, and accelerated computing platforms.
  • Provide architecture collaboration, mentorship, knowledge sharing, and design review participation across the organization.

Requirements

  • Bachelor's degree in computer science or a related technical field and 4+ years of technical engineering experience with coding, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.
  • Experience delivering technical solutions spanning multiple engineering teams, organizations, or business areas is preferred.
  • Ability to simplify complex technical challenges and create practical, scalable, maintainable solutions is preferred.
  • Technical influence, architectural leadership, mentoring, and cross-organizational collaboration experience are preferred.
  • Knowledge of large-scale distributed systems, cloud-native platforms, or infrastructure services in production environments is preferred.
  • Familiarity with AI infrastructure, HPC environments, accelerated computing, or large-scale GPU deployments is preferred.
  • Knowledge of datacenter architecture, rack-scale infrastructure, network topology, and modern datacenter networking is preferred.
  • Familiarity with InfiniBand, NVLink, NVSwitch, Ethernet, RDMA, SmartNICs, or DPUs is preferred.
  • Understanding of bare-metal infrastructure, hardware lifecycle management, fleet operations, infrastructure telemetry, or platform operations at scale is preferred.
  • Proficiency in one or more modern programming languages such as Go, Rust, C#, Java, or Python is preferred.

Benefits

  • Certain roles may be eligible for benefits and other compensation.
  • The position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me