Microsoft

Principal Software Engineer

Microsoft
Apply
6 days ago
Remote, United StatesStaff+
H1B sponsor

Base Salary

$166k - $331k/yr

Responsibilities

  • Lead architecture for near-real-time telemetry ingestion, processing, storage, and query across GPUs, hosts, networks, storage, power, cooling, and related supercomputer components.
  • Define and validate shared signal contracts and standards for freshness, completeness, correctness, availability, retention, access, and cost at production scale.
  • Connect telemetry to common resource identity, topology, and health models covering fleets, clusters, racks, nodes, GPUs, switches, links, dependencies, and blast radius.
  • Converge first-party and third-party GPU telemetry into a consistent operational model while accounting for provider-specific data gaps and quality differences.
  • Build foundations for AI-assisted anomaly detection, cross-signal correlation, likely-cause analysis, impact assessment, recommendations, and insight-quality evaluation loops.
  • Partner with customers, datacenter technicians, service owners, and engineering leads to define secure, role-based operational workflows and views.
  • Build dashboards and practical tools that help technicians identify component health, likely fault locations, repair context, and diagnostic next steps.
  • Create repair-validation workflows that verify signal changes, component and capacity recovery, and remaining unhealthy conditions.
  • Lead technical design reviews, manage cross-team dependencies, establish reusable interfaces and patterns, and guide work from proof of concept through production rollout.
  • Define and improve success measures including signal freshness, coverage, diagnosis time, repair time, recovery time, repair-verification latency, repeat repair attempts, and GPU-capacity impact.
  • Mentor engineers, influence teams across organizational boundaries, contribute to operational playbooks, and improve the platform through production learning.

Requirements

  • Bachelor’s degree in Computer Science or a related technical field and 8+ years of technical engineering experience with coding, or equivalent experience.
  • Coding experience in C, C++, C#, Java, JavaScript, or Python.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.
  • Preferred: master’s degree and 12+ years of experience, or bachelor’s degree and 15+ years of experience, or equivalent experience.
  • Experience architecting large-scale telemetry, streaming-data, or observability systems involving ingestion, processing, storage, query, real-time analytics, time-series data, topology or graph models, and fleet-scale visualization.
  • Experience leading cross-team technical design and production service delivery with focus on reliability, security, and operational readiness.
  • Experience with GPU infrastructure, AI training or inference systems, high-performance computing, or datacenter operations.
  • Knowledge of InfiniBand, Ethernet, NVLink, host and accelerator telemetry, and dependencies across compute, networking, storage, and facility systems.
  • Experience applying machine learning or AI to operational data for anomaly detection, correlation, root-cause assistance, and insight-quality evaluation.
  • Experience integrating telemetry from multiple providers or environments while maintaining common identity, schema, access-control, and data-quality standards.
  • Ability to translate complex infrastructure signals into customer-impact information and technician-ready repair workflows with measurable operational improvements.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me