1 day ago
Warsaw, PolandIntern
Responsibilities
- Design and build scalable model optimization software platforms for diverse AI models and optimization techniques.
- Develop and integrate generative AI optimization algorithms including quantization, speculative decoding, sparsity, distillation, pruning, and neural architecture search.
- Deploy optimized models into inference frameworks and develop APIs, model optimizations, and hardware-specific features.
- Collaborate on model optimization solutions for customer use cases and end-to-end accuracy-performance trade-offs.
- Profile GPU kernels and optimize attention kernels, KV-cache usage, and parallelism strategies.
Requirements
- Pursuing a Master’s or PhD in Computer Science, AI, Applied Math, or a related field.
- Strong deep learning background and hands-on experience with language models.
- Solid foundation in algorithms and programming.
- Proficiency in Python, PyTorch, and modern machine-learning frameworks and tools.
- Strong written and verbal communication skills and ability to work independently and collaboratively.
- Preferred experience includes model optimization, quantization, distillation, pruning, contributions to ML frameworks, large-scale GPU training or fine-tuning, GPU architectures, compilation stacks, performance analysis, and NVIDIA Model Optimizer or NeMo.
Benefits
- Internship pay for Poland is 117,750 PLN–204,100 PLN annually, prorated for the internship duration.
- NVIDIA offers a comprehensive benefits package and a diverse, equal-opportunity work environment.
Tech Stack
Categories
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.