Inference Engineer - Member of Technical Staff
Designworks Talent1 day ago
Bellevue, WA, USASenior
Responsibilities
- Build and operate production-grade model-serving and inference systems for high-throughput, low-latency AI workloads.
- Optimize inference infrastructure for token throughput, latency, scalability, GPU utilization, and cost efficiency across model architectures and workloads.
- Improve the scalability and operational maturity of inference platforms as customer demand grows.
- Partner with AI training, GPU performance, orchestration, infrastructure, and operations teams to transition models into production serving.
- Develop monitoring, alerting, and operational practices for reliable inference services.
- Investigate and resolve performance, reliability, and capacity challenges across inference workloads.
- Contribute to platform architecture decisions and engineering standards.
Requirements
- Experience building and operating production machine learning inference or model-serving systems at scale.
- Strong understanding of latency, throughput, memory utilization, and cost-efficiency trade-offs when serving large AI models.
- Experience designing reliable distributed systems or production infrastructure.
- Understanding of GPU-backed AI workloads and inference scaling challenges.
- Strong engineering fundamentals and ability to independently own complex technical problems.
- Experience with inference-serving frameworks such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, or similar technologies.
- Experience optimizing LLM inference workloads or large-scale AI serving platforms.
- Background operating API-based AI products or high-volume production services.
- Experience with GPU scheduling, distributed systems, Kubernetes, or cloud infrastructure platforms.
- Familiarity with quantization, batching, caching, or performance-tuning techniques.
- Experience at a hyperscaler, AI lab, GPU cloud provider, or large-scale ML infrastructure organization is preferred.
Benefits
- Competitive base pay for the Bellevue market.
- Eligible roles may receive merit increases, annual bonuses, and long-term incentives based on individual performance.
- U.S.-based employees receive medical, dental, and vision insurance, a 401(k) plan with company match, and paid holidays.
- Hybrid role based in the Bellevue, WA area, with approximately three days per week in the office.
- Candidates elsewhere in the U.S. who are open to relocation are encouraged to apply.
Tech Stack
Categories
About Designworks Talent
Designworks Talent specializes in the design and delivery of enterprise workforce solutions including strategy, talent acquisition, engagement, and succession planning. We work collaboratively with business leaders and enterprise Talent Acquisition and Human Resources teams to deliver custom workforce solutions to meet the dynamic talent demands of your business.