Microsoft

Principal Software Engineer

Microsoft
Apply
13 hours ago
Remote, United StatesStaff+
H1B sponsor

Base Salary

$143k - $304k/yr

Responsibilities

  • Define technical direction for cloud infrastructure and machine learning platforms across multiple engineering teams.
  • Design and review distributed systems supporting model training, model inference, data processing, and platform services.
  • Align architecture, reliability, security, scalability, and operational requirements with partner teams.
  • Improve compute utilization, resource management, platform efficiency, and service performance.
  • Support MLOps practices for model development, deployment, monitoring, and lifecycle management.
  • Provide technical guidance for Kubernetes-based platforms and AI workloads in production.
  • Lead long-term platform planning, technical standards, engineering best practices, and architecture decisions.
  • Mentor engineers and drive technical strategy across cross-functional engineering teams.

Requirements

  • Bachelor's degree in Computer Science or a related technical field and 6+ years of technical engineering experience with coding in Go, C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Preferred: master's degree with 8+ years of technical engineering experience, or bachelor's degree with 12+ years of technical engineering experience, or equivalent practical experience.
  • Deep experience with Kubernetes, containers, cloud platforms, networking, storage systems, site reliability engineering, and large-scale distributed systems.
  • Experience designing and operating machine learning platforms, large-scale model training environments, GPU infrastructure, distributed batch scheduling systems, MLOps frameworks, KubeRay, and Kueue.
  • Strong understanding of large language model and foundation model ecosystems, including training, inference, model serving, and observability.
  • Experience building and scaling enterprise AI infrastructure and platforms for production workloads.
  • Demonstrated ability to lead architecture decisions and technical strategy across cross-functional engineering teams.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me