Microsoft

Software Engineer II & Senior Software Engineer - AI Training Systems (CoreAI)

Microsoft
Apply
1 day ago
Redmond, WA, USAMid Level / Senior
H1B sponsor

Base Salary

$102k - $261k/yr

Responsibilities

  • Own and improve components of pre-training and post-training systems.
  • Profile and optimize data loading, sequence packing, activation memory, checkpoint I/O, throughput, latency, and cost.
  • Ship tested optimizations and reproducible benchmarks while preserving restart correctness, training quality, numerical correctness, and convergence.
  • Build secure, tenant-isolated systems with automated testing, observability, reliable recovery, and safe releases.
  • Provide operational support and improve services using production feedback.
  • Validate model and agent quality, including multi-turn task completion, tool-use correctness, and reward-exploitation checks for reinforcement learning.
  • Pursue near-linear throughput scaling across applicable GPU and node configurations.

Requirements

  • Bachelor's degree in computer science or a related technical field and 2+ years of technical engineering experience with coding, or equivalent experience.
  • Preferred: 5+ years of technical engineering experience with coding, or equivalent experience.
  • Python experience and hands-on training implementation using PyTorch, JAX, or comparable frameworks.
  • Experience diagnosing performance bottlenecks in training workloads.
  • Experience with Kubernetes, Ray, and training toolchains such as PyTorch, JAX, Slime, verl, or TRL.
  • Strong software engineering fundamentals, debugging skills, and cross-team communication.
  • Ability to meet Microsoft, customer, and government security screening requirements, including the Microsoft Cloud Background Check.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me