GrepJob
Cohere

Staff Software Engineer, Inference Infrastructure

Cohere
Apply
4 months ago
Toronto, Canada +4 moreStaff+
H1B Sponsor

Responsibilities

  • Develop, deploy, and operate AI platforms for large language models.
  • Collaborate with teams to deploy optimized NLP models in production.
  • Interface with customers to create customized deployments.
  • Manage compute, storage, and network resources effectively.
  • Troubleshoot and support complex Linux-based computing environments.

Requirements

  • 5+ years of engineering experience in production infrastructure.
  • Experience designing highly available distributed systems with Kubernetes.
  • Familiarity with cloud services like GCP, Azure, AWS, and hybrid environments.
  • Strong understanding of distributed systems and high-performance server languages.
  • Excellent collaboration and troubleshooting skills.

Benefits

  • Open and inclusive culture and work environment.
  • Weekly lunch stipend and in-office lunches & snacks.
  • Full health and dental benefits with a mental health budget.
  • 100% Parental Leave top-up for up to 6 months.
  • Personal enrichment benefits for arts, culture, fitness, and workspace improvement.
  • Remote-flexible work options and co-working stipend.
  • 6 weeks of vacation (30 working days).

Tech Stack

AWSAzureC++GoGoogle Cloud PlatformKubernetesLinux