VoiceAI Engineer

20 hours ago

Ho Chi Minh City, VietnamMid Level

Responsibilities

Own real-time orchestration of the ASR-to-LLM-to-TTS cascade, including streaming, state, and timing.
Build voice activity detection, end-of-turn detection, barge-in, interruption handling, and other real-time voice components.
Reduce end-to-end latency from incoming audio to first outgoing audio.
Integrate ASR/TTS vendors and self-hosted speech models behind tested interfaces.
Deploy and scale self-hosted speech models on GPUs using batching, streaming inference, and cost-per-call optimization.
Own monitoring, alerting, load testing, and incident response for the interaction layer with Datadog.
Work with Data Scientists to productionize model improvements through A/B testing and staged rollouts.
Collaborate with data science, product, telephony, and engineering teams on shared inbound and outbound call interfaces.

At least 3 years of backend or ML engineering experience with production real-time or streaming systems.
Strong Python skills and experience with asynchronous or concurrent programming.
Experience with WebSocket or WebRTC-based streaming.
Hands-on experience with real-time voice frameworks such as LiveKit or Pipecat, or equivalent media pipelines.
Experience integrating ASR/TTS APIs and working with audio formats, codecs, buffering, and jitter.
Experience across modeling, engineering, deployment, and production monitoring.
Solid engineering practices involving testing, containers, cloud deployment, and observability.
Preferred experience serving speech or LLM models on GPUs with tools such as vLLM, Triton, or TensorRT.
Familiarity with SIP or telephony concepts.
Experience with speech-to-speech models or cascade-versus-S2S architecture trade-offs is preferred.
Vietnamese, Tagalog, or US English voice-product experience is a plus.

13th-month salary and performance bonuses.
Comprehensive healthcare coverage for the employee and dependents.
Annual leave, sick leave, and flexible work hours.
On-site role at the central District 1 office in Vietnam.
On-site lunch with multiple options, including vegetarian choices.
Grab for work allowance and fully equipped workstations.
Team-building activities, sponsored sports clubs, and weekly Thursday happy hour.
Unlimited free coffee, tea, snacks, and fruit.
Opportunity to contribute to social-impact products that expand credit access.

DatadogPython

201-500 employees