Cohere

Staff Software Engineer, Data Infrastructure

Cohere
Apply
3 days ago

Base Salary

$245k - $335k/yr

Responsibilities

  • Design, architect, and operate the distributed storage system supporting model training and evaluation.
  • Lead deployment across multiple Kubernetes clusters at petabyte scale and establish organizational standards and best practices.
  • Collaborate with researchers and training-infrastructure teams to define data access patterns and throughput, latency, and durability requirements.
  • Solve networking, I/O, consistency, multi-region, and multi-backend data movement challenges.
  • Drive technical vision from concept through production and improve GPU utilization and time-to-insight.
  • Mentor others and lead implementations in Python or Go.

Requirements

  • Strong knowledge of storage fundamentals including replication, consistency, caching, and data lifecycle management.
  • Demonstrated architecture and design experience for storage or distributed systems.
  • Strong coding ability in Python and Go, with the ability to lead implementations and mentor others.
  • Experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets.
  • Ability to design and execute operational strategies for production systems.
  • Hands-on experience with cloud object storage such as S3 and POSIX-style filesystems.
  • Bonus: experience applying parallel or HPC filesystems such as Weka, VAST, or Lustre at scale.
  • Bonus: familiarity with data-loading and checkpointing patterns used in large-scale model training and evaluation.

Benefits

  • Weekly lunch stipend of $75/£75 or local-currency equivalent.
  • Full health and dental benefits, including a separate mental-health budget.
  • RRSP matching, 401K, and pension scheme.
  • 100% parental-leave top-up for up to six months for either parent.
  • Annual arts and culture, fitness and wellness, quality-time, workspace-improvement, education, learning, conference, course, and coaching benefits.
  • Six weeks of paid vacation, or 30 working days.
  • Remote-friendly work with offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.
  • Remote employees can receive travel budgets for other offices, an annual company offsite benefit, coworking support, and a $500 home-office stipend; office employees receive daily lunch, snacks, and community events.

Categories

BackendData Engineering
Cohere

About Cohere

1,001-5,000 employees

Cohere builds large language models and an enterprise AI platform that companies use for search, summarization, and workflow automation, delivered via API or private deployments. Founded in 2019 and headquartered in Toronto, it focuses on multilingual models, data controls, and options to run across major clouds or on-premises. The business is privately held and serves security- and compliance-sensitive organizations.

Contact me