Deepgram

ML Ops Infrastructure Engineer

Deepgram
Apply
4 months ago
Remote, Worldwide or New York, NY, USAMid Level
H1B Sponsor

Base Salary

$160k - $220k/yr

Responsibilities

  • Design and build CI/CD pipelines for ML model development, validation, and deployment.
  • Architect and maintain pipelines that move models from research through staging to production.
  • Build A/B testing infrastructure for controlled model rollouts and real-world performance measurement.
  • Implement monitoring for production model accuracy, latency, drift, and regressions.
  • Develop automated retraining pipelines triggered by data changes, performance degradation, or schedules.
  • Create production-mirroring build and test environments for high-fidelity researcher feedback.
  • Establish model versioning, artifact management, and rollback capabilities.
  • Collaborate with research engineers to define and enforce model quality gates.
  • Build observability dashboards for real-time model health across environments.
  • Optimize model-serving infrastructure for latency, throughput, and cost efficiency.

Requirements

  • At least 4 years of experience in MLOps, DevOps, or infrastructure engineering focused on ML systems.
  • Strong proficiency in Python and experience building automation and tooling for ML workflows.
  • Deep experience with CI/CD systems and pipelines for software and model delivery.
  • Hands-on experience with Docker and Kubernetes for containerized workloads.
  • Practical experience deploying and serving ML models in production.
  • Familiarity with model evaluation, validation, and quality assurance processes.
  • Understanding of monitoring and observability principles for ML systems.
  • Experience with model serving frameworks such as NVIDIA Triton Inference Server, TensorRT, or ONNX Runtime is preferred.
  • Background in speech, audio, or real-time media ML systems is preferred.
  • Experience with Terraform or Pulumi is preferred.
  • Experience with Prometheus, Grafana, Datadog, or similar monitoring and observability stacks is preferred.
  • Familiarity with GPU-accelerated inference optimization, profiling, feature stores, data versioning, ML metadata management, canary deployments, or progressive delivery is preferred.

Benefits

  • Medical, dental, and vision benefits
  • Annual wellness stipend and mental health support
  • Life, short-term disability, and long-term disability insurance plans
  • Unlimited paid time off, generous paid parental leave, flexible schedule, and 12 paid US company holidays
  • Quarterly personal productivity stipend and one-time home office upgrade stipend
  • 401(k) plan with company match and tax savings programs
  • Learning and education stipend, conference participation, employee resource groups, and AI enablement workshops
  • Benefits for international employees are administered locally through an Employer of Record and vary by region

Tech Stack

DatadogDockerGrafanaKubernetesPrometheusPythonTerraform
Deepgram

About Deepgram

51-200 employees

Deepgram is the real-time API platform powering the trillion-dollar Voice AI economy. Backed by a $130M Series C at a $1.3B valuation, Deepgram is trusted by 200,000+ developers and 1,300+ organizations to build Voice AI products, platforms, and autonomous agents with the lowest latency, highest accuracy, and enterprise reliability. Our voice-native foundation models and runtime infrastructure have processed 50,000+ years of audio and over 1 trillion words, making Deepgram the most experienced voice AI platform in the world. Industry-leading models & platform: 👂 Nova-3 — the world’s most accurate real-time speech-to-text model 🔊 Aura-2 — professional, enterprise-grade text-to-speech 💬 Flux — the first Conversational Speech Recognition model designed to handle interruptions 🚀 Voice Agent API — enterprise-ready, real-time conversational AI 🧠 Saga — the Voice OS Beyond core infrastructure, Deepgram is expanding the Voice AI ecosystem through: 💪 Powered by Deepgram, supporting voice products built by leading AI startups and enterprise organizations 🌉 A new Voice AI Collaboration Hub in San Francisco for builders, partners, and the voice community 🍔 The acquisition of OfOne, delivering real-time Voice AI for restaurants and drive-thru operations with 95%+ containment 📃 A growing patent portfolio in Voice AI Much like APIs powered the payments and cloud economies, Deepgram is building the foundation for a trillion-dollar B2B Voice AI economy—centered on the most natural human interface: voice.