Cohere

Senior/Staff Software Engineer (Back-End), Inference

Cohere
Apply
23 hours ago
Toronto, Canada +4 moreSenior / Staff+
H1B sponsor

Base Salary

$205k - $315k/yr

Responsibilities

  • Scale backend systems for authentication, authorization, deployments, billing, metering, and customer lifecycle management.
  • Lead architecture initiatives across identity, payments, usage systems, platform scalability, and core product foundations.
  • Build control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platforms.
  • Design reliable APIs and distributed systems with guarantees for correctness, consistency, isolation, failure recovery, idempotency, and observability.
  • Implement security and privacy architecture, including tenant isolation, least-privilege access, auditability, secrets management, encryption, and confidential computing boundaries.
  • Drive projects from architecture and threat modeling through implementation, rollout, production operations, and iteration based on customer workloads.

Requirements

  • Strong backend engineering fundamentals in distributed systems, databases, networking, operating systems, and security.
  • Production-system programming experience with Go, Python, Java, C++, Rust, or similar languages.
  • Experience designing and operating production systems where correctness, availability, security, and performance matter at significant scale.
  • Ability to define architecture and deliver ambiguous, high-impact technical problems through reliable production systems.
  • Strong understanding of concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, and graceful degradation.
  • Understanding of authentication, authorization, identity, cryptography, secrets, tenant isolation, and security boundaries.
  • Experience reasoning across backend services, APIs, databases, distributed systems, and cloud infrastructure.
  • Experience with instrumentation, capacity planning, migrations, backwards compatibility, incident response, and safe rollouts.
  • Track record of taking technically difficult projects from unclear beginnings to systems relied upon by engineers and customers.

Benefits

  • Weekly lunch stipend of $75/£75 or equivalent in local currency.
  • Full health and dental benefits, including a separate mental-health budget.
  • RRSP matching, 401K, and Pension Scheme.
  • 100% parental-leave top-up for up to six months for either parent.
  • Annual enrichment benefits covering arts and culture, fitness and wellness, quality time, and workspace improvement.
  • Education and learning stipend for conferences, courses, and coaching.
  • Six weeks of paid vacation, or 30 working days.
  • Remote-friendly work with offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.
  • Remote employees receive travel support for other offices, an annual company offsite, a co-working benefit, and a $500 home-office stipend; office employees receive lunch, snacks, and community events.

Categories

Cohere

About Cohere

1,001-5,000 employees

Cohere builds large language models and an enterprise AI platform that companies use for search, summarization, and workflow automation, delivered via API or private deployments. Founded in 2019 and headquartered in Toronto, it focuses on multilingual models, data controls, and options to run across major clouds or on-premises. The business is privately held and serves security- and compliance-sensitive organizations.

Contact me