Microsoft

Principal Software Engineer - AI Training Systems (CoreAI)

Microsoft
Apply
1 day ago
Redmond, WA, USAStaff+
H1B sponsor

Base Salary

$143k - $331k/yr

Responsibilities

  • Own distributed-training performance across pre-training, fine-tuning, and reinforcement learning.
  • Apply FSDP/ZeRO, tensor, pipeline, and expert parallelism, mixed precision, recomputation, and communication overlap.
  • Connect asynchronous agent rollouts and feedback to training while balancing resources, bounding staleness, and improving recovery.
  • Mentor engineers and validate multi-node scaling against quality targets.
  • Build secure, tenant-isolated systems with automated testing, observability, reliable recovery, and safe releases.
  • Provide operational support and improve services using production feedback.
  • Preserve model quality and numerical correctness through reproducible benchmarking and convergence validation.
  • Improve throughput, latency, GPU-hours, and training cost across agreed GPU and node configurations.
  • Validate held-out model and agent quality, including multi-turn task completion, tool-use correctness, and reward-exploitation checks for reinforcement learning.

Requirements

  • Bachelor's degree in computer science or a related technical field and 6+ years of technical engineering experience with coding, or equivalent experience.
  • Experience coding in one or more of C, C++, C#, Java, JavaScript, or Python.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Preferred: 8+ years of technical engineering experience with coding or equivalent experience.
  • Preferred: production distributed-training delivery and strong compute, memory, communication, and convergence fundamentals.
  • Preferred: proven software engineering, debugging, and cross-team communication skills.
  • Preferred: experience building training services used by customers or research teams.
  • Preferred: experience with Kubernetes, Ray, PyTorch, JAX, Slime, verl, or TRL.

Benefits

  • Base pay is listed by level and location, with additional benefits and other compensation potentially available.
  • The position is open for at least five days and accepts applications on an ongoing basis until filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me