Microsoft

Senior Software Engineer(M365 Copilot Inferencing)

Microsoft
Apply
2 days ago
Suzhou, China +2 moreSenior

Responsibilities

  • Partner with stakeholders to identify requirements, dependencies, and designs for services and platforms.
  • Build and ship production-quality solutions that improve performance, maintainability, effectiveness, quality, and reliability.
  • Design and implement large-scale model-serving services involving routing, load balancing, distributed caching and storage, networking, and geographic disaster recovery.
  • Serve as a Designated Responsible Individual, participate in on-call, monitor production systems, and restore service during degradation or downtime.
  • Improve availability, reliability, efficiency, observability, performance, monitoring, and operational consistency at scale.
  • Coordinate project and release execution with engineers, product managers, and partner teams.
  • Mentor engineers and improve code quality and engineering practices through code and design reviews.

Requirements

  • Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience with coding, or equivalent experience.
  • Coding experience in C, C++, C#, Java, JavaScript, or Python.
  • Ability to meet Microsoft Cloud Background Check and applicable customer or government security screening requirements.
  • Preferred: Master's degree and 6+ years of technical engineering experience, or bachelor's degree and 8+ years of technical engineering experience, or equivalent experience.
  • Experience building cloud applications or services and delivering production-quality software with strong debugging and problem-solving skills.
  • Experience with distributed software design, cloud systems architecture, distributed systems, near-real-time processing, or large data platforms.
  • Experience improving production systems for reliability, performance, and observability at scale.
  • Familiarity with model serving, GPU efficiency, and large-scale request routing; GPU inference optimization experience is a plus.
  • Strong communication, collaboration, ownership, and end-to-end service operation skills.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me