GitHub

Software Engineer III, Copilot Models Inference

GitHub
Apply
17 hours ago
Remote, United StatesSenior
H1B sponsor

Base Salary

$108k - $286k/yr

Responsibilities

  • Design, implement, test, deploy, and maintain backend services and APIs connecting GitHub Copilot experiences to model providers.
  • Own features end to end through technical design, implementation, operational readiness, rollout, measurement, and follow-up.
  • Integrate models and provider capabilities while managing compatibility, capacity, failure modes, and safe fallback behavior.
  • Improve latency, throughput, capacity efficiency, availability, and reliability using production data.
  • Maintain automated tests, dashboards, alerts, runbooks, diagnostics, and other service-health safeguards.
  • Participate in code reviews, design discussions, documentation, on-call rotations, incident response, and service restoration.
  • Use progressive delivery and production evidence to reduce risk when launching models or changing routing and provider integrations.
  • Collaborate with Models Lifecycle, product, safety, infrastructure, and external provider partners.

Requirements

  • At least 4 years of software engineering or related technical experience with production software, or an Associate’s Degree and 3+ years of experience, or a Bachelor’s Degree and 2+ years of relevant experience, or a Master’s Degree in a listed technical field, or equivalent experience.
  • Proven coding experience in one or more of C, C++, C#, JavaScript, Go, Ruby, Rust, or Python.
  • Experience applying software design principles to build maintainable and testable systems is preferred.
  • Experience with relational databases and NoSQL data stores is preferred.
  • Experience building or operating cloud-native services, including containers, Kubernetes, or managed cloud infrastructure, is preferred.
  • Experience with AI or large language model inference systems, model APIs, or model-provider integrations is preferred.
  • Experience with observability, reliability engineering, latency, capacity, resilience, or production incident response is preferred.
  • Experience with canary releases, feature flags, progressive delivery, or similar safe-rollout practices is preferred.

Benefits

  • Remote-first work arrangement from within the United States.
  • Eligible roles may receive benefits, annual bonuses, stock, and other rewards in addition to base pay.
  • Generous learning and growth opportunities and benefits supporting employees wherever they work.
  • Applications are accepted on an ongoing basis until the position is filled, with the posting open for at least 3 days.
GitHub

About GitHub

5,001-10,000 employees

GitHub builds a cloud platform for software development that hosts code repositories, collaboration, and automation, including GitHub Actions, Packages, and Copilot. It sells paid plans and enterprise subscriptions for organizations and developers, plus add-ons and a marketplace. Founded in 2008 and headquartered in San Francisco, it is owned by Microsoft and is widely used by open-source communities and enterprises worldwide.

Contact me