GrepJob
Together AI

Senior Platform Engineer, Voice AI

Together AI
Apply
4 days ago

Base Salary

$200k - $260k/yr

Responsibilities

  • Build and harden real-time WebSocket and HTTP streaming APIs for STT and TTS.
  • Design and ship autoscaling for voice model endpoints handling bursty traffic.
  • Implement voice-specific API features like word-level alignment and speaker diarization.
  • Build voice-specific observability tools for latency and audio quality monitoring.
  • Own multi-model normalization across various model partners.
  • Collaborate with ML engineering to ensure latency and reliability requirements are met.
  • Contribute to developer experience through API design and documentation.
  • Lay the groundwork for future product developments.

Requirements

  • 5+ years of experience building large-scale, real-time distributed systems and API services.
  • Deep expertise in real-time streaming infrastructure and WebSocket server architecture.
  • Expert-level programming skills in TypeScript and Python; Rust experience is a plus.
  • Strong fundamentals in distributed systems, including load balancing and autoscaling.
  • Experience with Kubernetes for managing stateful services.
  • Strong product sense with a focus on API ergonomics.
  • Comfortable working in a small, fast-paced team environment.
  • Experience with audio or media protocols is a strong plus.
  • Familiarity with ML model serving infrastructure is a plus.
  • Full-stack experience with React or Next.js is a nice-to-have.
  • Bachelor's or Master's degree in Computer Science or related field, or equivalent experience.

Benefits

  • Competitive compensation and startup equity.
  • Health insurance and other competitive benefits.

Tech Stack

KubernetesNext.jsPythonReactRustTypeScript