10 hours ago
Base Salary
$120k - $261k/yr
Responsibilities
- Diagnose and resolve communication-related performance bottlenecks across large-scale distributed systems.
- Analyze InfiniBand fabric behavior, including congestion, credit starvation, route imbalance, and link-level errors.
- Tune and debug RDMA transport layers, message ordering, path migration, and QoS policies across multi-rail and multi-subnet fabrics.
- Develop tooling and scripts to analyze fabric telemetry, traffic flows, and job-induced network behavior.
- Collaborate with operations teams to optimize adaptive routing, congestion control, and service-level tuning.
- Work with hardware vendors such as NVIDIA to evaluate and validate next-generation interconnects and switch firmware.
- Benchmark HPC and AI workloads by characterizing latency, bandwidth, and collective efficiency at scale.
Requirements
- Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience with coding, or equivalent experience.
- Ability to pass Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
- Preferred: master's degree and 6+ years of technical engineering experience, or bachelor's degree and 8+ years of technical engineering experience, or equivalent experience.
- Proven experience debugging network performance issues at scale, including link-level failures, fabric hot spots, and routing asymmetry.
- Expert-level experience with MPI, NCCL, and collective algorithms in multi-node, multi-GPU systems.
- Deep knowledge of InfiniBand architecture, verbs, RDMA, SHARP, adaptive routing, congestion control, and QoS.
- Familiarity with job schedulers, network-aware scheduling, topology constraints, GPU Direct RDMA, and NVLink topologies.
- Experience tuning transformer training, large-scale AllReduce, or model/data-parallel AI workloads.
Benefits
- U.S. base pay range is USD $119,800-$234,700 per year, with a separate San Francisco Bay Area and New York City range of USD $160,200-$261,000 per year.
- Certain roles may be eligible for benefits and other compensation.
- The position is open for a minimum of 5 days and accepts applications on an ongoing basis until filled.
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.
