Microsoft

Senior AI Software Architect

Microsoft
Apply
3 days ago
Boston, MA, USA +2 moreSenior
H1B Sponsor

Base Salary

$166k - $296k/yr

Responsibilities

  • Lead end-to-end software architecture and performance optimization for AI accelerator platforms.
  • Prototype and validate software capabilities across kernels, compiler and runtime layers, distributed training and inference frameworks, and serving infrastructure.
  • Analyze large-scale workloads to identify performance bottlenecks, numerical correctness issues, and system-level efficiency opportunities.
  • Use workload insights to guide hardware-software co-design decisions across architecture, silicon, systems software, networking, and product teams.
  • Define requirements, evaluate tradeoffs, and deliver practical solutions for production-scale AI systems.

Requirements

  • Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Preferred qualifications include a PhD, master's degree, or bachelor's degree in Computer Science, Computer Architecture, Electrical Engineering, Computer Engineering, Machine Learning, High-Performance Computing, or a related field, with the specified experience alternatives.
  • Experience designing, building, or optimizing systems software for AI, machine learning, high-performance computing, or distributed systems.
  • Experience analyzing large-scale AI training runs, including loss curves, convergence behavior, gradient flow, activation statistics, and numerical stability.
  • Experience debugging training correctness issues such as gradient divergence, NaNs/Infs, optimizer behavior, mixed-precision instability, distributed synchronization bugs, or hardware/software numerical differences.
Microsoft

About Microsoft

10,000+ employees

Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting in differences. Because impact matters. Microsoft operates in 190 countries and is made up of approximately 228,000 passionate employees worldwide.

Contact me