7 months ago
Serbia (city not specified)Senior / Staff+
Responsibilities
- Optimize real-time inference systems and multimodal models.
- Take models from research to production, ensuring reliability.
- Implement techniques for model acceleration and inference optimization.
- Collaborate with teams to address performance and latency challenges.
- Contribute to open-source projects and technical documentation.
Requirements
- Deep understanding of modern serving frameworks like vLLM or TRT-LLM.
- Hands-on experience with quantization, distillation, and caching strategies.
- Proficiency in C++, CUDA, Rust, or optimized Python for high-performance systems.
- Experience with Kubernetes and multi-GPU/multi-node inference.
- PhD in CS, Physics, Math, or equivalent practical experience.
Benefits
- Full U.S. visa and relocation support may be available for candidates interested in relocating to the San Francisco Bay Area.
Tech Stack
Categories
About Inworld
Inworld builds real-time voice AI and agent infrastructure for developers, including text-to-speech, speech-to-speech, speech recognition, and LLM routing delivered via APIs and SDKs. Customers use it to create interactive characters and agentic experiences in games, apps, and virtual worlds; revenue comes from usage-based and enterprise licensing. Founded in 2021 and headquartered in Mountain View, California, the company is privately held and works with game studios and large technology firms.