Nvidia

Senior Solutions Architect – Large Scale AI Inference

Nvidia
Apply
6 hours ago
Remote, EMEASenior

Responsibilities

  • Guide EMEA AI-native customers in deploying and optimizing large-scale inference workloads on multi-node GPU clusters.
  • Architect efficient inference pipelines for dense and sparse or latent Mixture-of-Experts models across thousands of GPUs.
  • Improve inference efficiency through quantization, speculative decoding, disaggregated prefill and decode, KV cache management, and WideEP.
  • Collaborate with NVIDIA product teams on Dynamo, TensorRT-LLM, and NIXL to accelerate customer success.
  • Lead technical workshops, hackathons, and reference-architecture activities for the EMEA AI inference developer community.
  • Establish technical direction for scalable, high-performance AI inference in demanding production environments.

Requirements

  • MS or PhD in Computer Science, Engineering, or High-Performance Computing, or equivalent professional experience.
  • At least 5 years of experience in neural-network inference optimization.
  • Strong understanding of transformer inference optimization, including quantization, disaggregated inference, speculative decoding, continuous batching, and KV cache optimization.
  • Practical experience with large-scale MoE inference, including expert parallelism, WideEP, all-to-all communication, routing overhead, and load balancing.
  • Ability to engage deeply with ML engineers, researchers, and systems architects.
  • Hands-on experience with NVIDIA Dynamo, NIXL, Grove, or emerging disaggregated inference tooling is preferred.
  • Understanding of GPU memory hierarchies and high-speed interconnects such as NVLink, InfiniBand, RDMA, and UCX is preferred.
  • Experience contributing to advanced AI labs or large-scale AI infrastructure providers, or publishing work and benchmarks in large-scale AI inference, is preferred.

Benefits

  • NVIDIA offers competitive salaries and a comprehensive benefits package.
  • For Poland, the base salary range is 292,500 PLN to 507,000 PLN.
  • NVIDIA is an equal opportunity employer committed to a diverse work environment.

Categories

Solutions Engineering
Nvidia

About Nvidia

10,000+ employees

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Contact me