AI Inference Engineer QVAC (100% remote Worldwide)
Tether Operations Limited8 months ago
Remote, WorldwideSenior
Responsibilities
- Develop and deploy machine learning models to edge devices using llama.cpp and ggml.
- Build, port, enhance, and optimize the C++ inference runtime for startup performance, memory pressure, throughput, latency, stability, and hardware compatibility.
- Define and evolve core runtime abstractions used by inference features.
- Collaborate with researchers on coding, training, and transitioning models from research to production.
- Integrate AI features into existing products.
- Enable private, fast, on-device AI experiences without relying on cloud infrastructure.
Requirements
- Strong programming skills in C++.
- Strong experience with llama.cpp and ggml inference engines for deploying models to specific GPU architectures.
- Experience with at least one of CUDA, Vulkan, Metal, or OpenCL.
- Good understanding of deep learning concepts and model architectures.
- Experience with transformers, LLMs, and diffusion models.
- Ability to rapidly learn new technologies and techniques.
- A degree in Computer Science, AI, Machine Learning, or a related field, plus a solid track record in AI R&D.
- Preferred experience training or fine-tuning LLMs, productionizing models, researching new model architectures, distributed systems, and JavaScript.
Benefits
- 100% remote worldwide work arrangement.
- Opportunity to work on private, on-device AI and peer-to-peer products in a global fintech and technology company.
Tech Stack
Categories
About Tether Operations Limited
Tether Operations Limited develops and issues reserve-backed digital tokens used by exchanges, wallets, payment processors, and merchants, most notably the USDT stablecoin available across multiple blockchains. Founded in 2014 and privately held, it earns revenue from token issuance, reserve management, and related services, and has expanded into tokenization, peer-to-peer communications (Keet), and Bitcoin mining. USDT is widely used in crypto trading and cross-border transfers, including in emerging markets.