Microsoft

Senior Software Engineer(M365 Copilot Inferencing)

Microsoft
Apply
6 days ago
Suzhou, China or Shanghai, ChinaSenior

Responsibilities

  • Partner with stakeholders to define requirements, identify dependencies, and contribute to design documents for services and platforms.
  • Build, ship, and improve production-quality software for performance, maintainability, reliability, and effectiveness.
  • Design and implement large-scale model-serving services involving routing, load balancing, distributed caching and storage, networking, and geographic disaster recovery.
  • Participate in on-call operations as a Designated Responsible Individual and monitor systems for degradation, downtime, and interruptions.
  • Improve availability, reliability, efficiency, observability, and performance through consistent monitoring and operational practices.
  • Collaborate with engineers, product managers, and partner teams on project plans, releases, and execution.
  • Mentor engineers through code and design reviews and promote strong engineering practices.

Requirements

  • Bachelor’s degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages including C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Ability to meet Microsoft Cloud background check and applicable customer or government security screening requirements.
  • Experience building cloud applications or services and delivering production-quality software.
  • Understanding of distributed software design patterns and cloud systems architecture, including containers, load balancing, queuing, and caching.
  • Experience designing distributed systems, near-real-time processing solutions, or large data platforms in complex cloud or SaaS environments.
  • Experience improving production systems for reliability, performance, and observability at scale.
  • Familiarity with model serving, GPU efficiency, and large-scale request routing; GPU inference optimization experience is a plus.
  • Master’s degree with 6+ years of experience or bachelor’s degree with 8+ years of experience is preferred.
  • Strong communication, collaboration, ownership, debugging, and problem-solving abilities are preferred.

Benefits

  • The position is open for a minimum of five days, with applications accepted on an ongoing basis until filled.
  • Microsoft provides an inclusive equal opportunity workplace and offers assistance for religious and disability accommodations during the application process.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me