Deepgram

Site Reliability Engineer - AI & ML Infrastructure (Kubernetes, AWS & Terraform)

Deepgram
Apply
5 months ago
Remote, Worldwide or New York, NY, USASenior
H1B Sponsor

Base Salary

$150k - $220k/yr

Responsibilities

  • Architect and maintain Kubernetes-based computing platforms across AWS and on-premise environments.
  • Develop and manage reproducible, versioned, and automated infrastructure using Terraform and Infrastructure-as-Code principles.
  • Design and optimize AI/ML job scheduling and orchestration by integrating Slurm with Kubernetes clusters.
  • Provision, manage, and maintain bare metal server infrastructure for high-performance GPU computing.
  • Implement networking and storage solutions, including CNI, service mesh, CSI, and S3, for hybrid workloads.
  • Build observability capabilities covering monitoring, logging, and tracing.
  • Create automation for operational tasks, incident response, and performance tuning.
  • Collaborate with AI researchers and ML engineers to build infrastructure tools and development workflows.
  • Automate the lifecycle of single-tenant managed deployments.

Requirements

  • At least 5 years of experience in Platform Engineering, DevOps, or Site Reliability Engineering.
  • Hands-on experience building and managing production infrastructure with Terraform.
  • Expert-level knowledge of Kubernetes architecture and operations in large-scale environments.
  • Experience with HPC job schedulers, specifically Slurm, for GPU-intensive AI workloads.
  • Experience managing bare metal infrastructure, including provisioning with tools such as PXE boot and MAAS, configuration, and lifecycle management.
  • Strong scripting and automation skills using technologies such as Python, Go, or Bash.
  • Experience with CI/CD systems such as GitLab CI, Jenkins, or ArgoCD is preferred.
  • Experience building developer tooling is preferred.
  • Familiarity with FinOps principles and cloud cost optimization is preferred.
  • Knowledge of Kubernetes networking solutions such as Calico and Cilium is preferred.
  • Knowledge of Kubernetes storage solutions such as Ceph and Rook is preferred.
  • Experience in multi-region or hybrid cloud environments is preferred.

Benefits

  • Medical, dental, and vision benefits
  • Annual wellness stipend
  • Mental health support
  • Life, short-term disability, and long-term disability income insurance plans
  • Unlimited paid time off
  • Paid parental leave
  • Flexible schedule
  • 12 paid U.S. company holidays
  • Quarterly personal productivity stipend
  • One-time home office upgrade stipend
  • 401(k) plan with company match
  • Tax savings programs
  • Learning and education stipend
  • Participation in talks and conferences
  • Employee Resource Groups
  • AI enablement workshops and sessions
  • Benefits are administered locally through an Employer of Record model in many countries and vary by region

Tech Stack

AWSBashGitLab CI/CDGoJenkinsKubernetesPythonTerraform

Categories

DevOpsSite Reliability
Deepgram

About Deepgram

51-200 employees

Deepgram is the real-time API platform powering the trillion-dollar Voice AI economy. Backed by a $130M Series C at a $1.3B valuation, Deepgram is trusted by 200,000+ developers and 1,300+ organizations to build Voice AI products, platforms, and autonomous agents with the lowest latency, highest accuracy, and enterprise reliability. Our voice-native foundation models and runtime infrastructure have processed 50,000+ years of audio and over 1 trillion words, making Deepgram the most experienced voice AI platform in the world. Industry-leading models & platform: 👂 Nova-3 — the world’s most accurate real-time speech-to-text model 🔊 Aura-2 — professional, enterprise-grade text-to-speech 💬 Flux — the first Conversational Speech Recognition model designed to handle interruptions 🚀 Voice Agent API — enterprise-ready, real-time conversational AI 🧠 Saga — the Voice OS Beyond core infrastructure, Deepgram is expanding the Voice AI ecosystem through: 💪 Powered by Deepgram, supporting voice products built by leading AI startups and enterprise organizations 🌉 A new Voice AI Collaboration Hub in San Francisco for builders, partners, and the voice community 🍔 The acquisition of OfOne, delivering real-time Voice AI for restaurants and drive-thru operations with 95%+ containment 📃 A growing patent portfolio in Voice AI Much like APIs powered the payments and cloud economies, Deepgram is building the foundation for a trillion-dollar B2B Voice AI economy—centered on the most natural human interface: voice.