Microsoft

Senior Software Engineer

Microsoft
Apply
10 hours ago
Remote, United StatesSenior
H1B sponsor

Base Salary

$120k - $261k/yr

Responsibilities

  • Diagnose and resolve communication-related performance bottlenecks across large-scale distributed systems.
  • Analyze InfiniBand fabric behavior, including congestion, credit starvation, route imbalance, and link-level errors.
  • Tune and debug RDMA transport layers, message ordering, path migration, and QoS policies across multi-rail and multi-subnet fabrics.
  • Develop tooling and scripts to analyze fabric telemetry, traffic flows, and job-induced network behavior.
  • Collaborate with operations teams to optimize adaptive routing, congestion control, and service-level tuning.
  • Work with hardware vendors such as NVIDIA to evaluate and validate next-generation interconnects and switch firmware.
  • Benchmark HPC and AI workloads by characterizing latency, bandwidth, and collective efficiency at scale.

Requirements

  • Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience with coding, or equivalent experience.
  • Ability to pass Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Preferred: master's degree and 6+ years of technical engineering experience, or bachelor's degree and 8+ years of technical engineering experience, or equivalent experience.
  • Proven experience debugging network performance issues at scale, including link-level failures, fabric hot spots, and routing asymmetry.
  • Expert-level experience with MPI, NCCL, and collective algorithms in multi-node, multi-GPU systems.
  • Deep knowledge of InfiniBand architecture, verbs, RDMA, SHARP, adaptive routing, congestion control, and QoS.
  • Familiarity with job schedulers, network-aware scheduling, topology constraints, GPU Direct RDMA, and NVLink topologies.
  • Experience tuning transformer training, large-scale AllReduce, or model/data-parallel AI workloads.

Benefits

  • U.S. base pay range is USD $119,800-$234,700 per year, with a separate San Francisco Bay Area and New York City range of USD $160,200-$261,000 per year.
  • Certain roles may be eligible for benefits and other compensation.
  • The position is open for a minimum of 5 days and accepts applications on an ongoing basis until filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me