Microsoft

Software Engineer II - AI Infrastructure

Microsoft
Apply
22 hours ago
Redmond, WA, USA or Mountain View, CA, USAMid Level
H1B sponsor

Base Salary

$102k - $219k/yr

Responsibilities

  • Design and build scalable, reliable architectures for AI systems, including inference backends and API interfaces.
  • Apply distributed systems principles to create robust, high-performance solutions.
  • Debug existing components, resolve issues quickly, and deliver critical fixes while maintaining system integrity.
  • Collaborate with internal teams and external partners to solve complex technical problems and deliver integrated solutions.
  • Identify innovative technical approaches, architect features, and iterate toward measurable outcomes.
  • Work across the full technology stack, from infrastructure to APIs, to deliver end-to-end solutions.

Requirements

  • Bachelor’s degree in computer science or a related technical field and 2+ years of technical engineering experience with coding, or equivalent experience.
  • Experience coding in languages including C, C++, C#, Java, JavaScript, or Python.
  • Preferred qualifications include a master’s degree and 3+ years of technical engineering experience, or a bachelor’s degree and 5+ years of technical engineering experience, or equivalent experience.
  • Knowledge of distributed systems, scalable architecture, API design, and ML/AI fundamentals and practical applications.
  • Experience delivering AI-based solutions.
  • Familiarity with Kubernetes, Azure DevOps, Docker, AI/ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, AutoGen, Semantic Kernel, and LangChain.
  • Optional experience with the OpenAI API or Azure OpenAI.
  • Strong communication, collaboration, problem-solving, decision-making under ambiguity, strategic thinking, and adaptability.

Benefits

  • Base pay is listed separately for general U.S. locations and the San Francisco Bay Area and New York City metropolitan areas.
  • Certain roles may be eligible for benefits and other compensation.
  • The position is based in Mountain View, CA, or Redmond, WA.
  • Applications are accepted on an ongoing basis until the position is filled, with the posting open for a minimum of five days.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me