5 hours ago
Tokyo, JapanMid Level
Responsibilities
- Embed with enterprise customers to understand communications workflows, AI use cases, and integration challenges.
- Design and deploy custom implementations involving AI voice assistants, Telnyx APIs, WebRTC, and other connectivity services.
- Deploy and operate LiteLLM and self-hosted or hosted open-weight model integrations, including routing, fallbacks, rate limits, virtual keys, and governance.
- Build production observability with metrics, logs, traces, dashboards, alerting, cost tracking, caching, and usage controls.
- Design model-routing strategies and adapt models through prompt, retrieval-augmented generation, and evaluation pipelines for Japanese and English use cases.
- Lead POCs, pilots, production launches, customer troubleshooting, and handoff documentation from whiteboard to stable go-live.
- Collaborate with Product and Engineering to shape the roadmap based on field insights from Japan and APAC.
Requirements
- A CS degree or equivalent experience.
- At least 3 years of experience building and shipping production software used by real users.
- Proficiency in multiple languages among Python, Node.js/TypeScript, and Go.
- Practical experience with production model integrations, rate limits, retries, streaming, token accounting, cost attribution, and concurrency failure modes.
- Experience deploying containerized services on Kubernetes and managing secrets, configuration, and upgrades.
- Experience with production observability using tools such as Prometheus, Grafana, OpenTelemetry, Graylog, or ELK.
- High-concurrency experience with Kafka, message queues, or event streams, including partitioning, consumer groups, and backpressure.
- Experience building APIs, including OpenAPI, REST or GraphQL design, authentication, rate limiting, versioning, and idempotency.
- Customer-facing engineering experience, including technical discovery, executive presentations, troubleshooting, and high-stakes technical conversations.
- Exposure to SIP, WebRTC, or real-time voice and messaging systems.
- Excellent written and verbal communication in English and Japanese.
- Based in Tokyo or willing to relocate, legally authorized to work in Japan or eligible for sponsorship, and able to travel across Japan and APAC.
- Preferred experience includes AI voice assistants, STT/TTS, LLM evaluation, LiteLLM or comparable gateways, open-weight models, vLLM, SGLang, TGI, Ollama, SQL, ETL, CI/CD, telecom or CPaaS, sovereign or on-premises deployments, and security controls such as IAM, encryption, and audit logging.
Benefits
- Hybrid role based in Tokyo with travel across Japan and the broader APAC region.
Tech Stack
Categories
Forward Deployed
About Telnyx
Telnyx builds a communications platform and AI infrastructure for developers and enterprises, offering SIP trunking, voice and messaging APIs, WhatsApp Business, eSIM/IoT connectivity, and low-latency inference on a private global IP network. The privately held company, founded in 2009 and headquartered in Austin, operates worldwide and holds a Saudi VVSP license with regional anchorsites for data locality. Revenue comes from usage-based APIs and enterprise connectivity services.