Research Engineer, GPU Performance
Mistral AI7 hours ago
Munich, GermanySenior
Responsibilities
- Develop low-level code, including custom kernels, memory-layout optimizations, and communication optimizations, to maximize high-end GPU utilization.
- Rethink generative-model architecture components for efficient inference in collaboration with Research Scientists.
- Integrate low-level optimized code into a high-level MLOps framework for reuse across training runs and deployments.
- Profile and benchmark large-scale training and inference across thousands of GPUs.
- Model LLM execution on different GPUs to assess hardware usage and estimate serving performance.
Requirements
- Demonstrated high technical competence writing custom low-level kernels and optimizing GPUs.
- High expertise in distributed computation infrastructure for current-generation GPU clusters.
- Overall understanding of generative AI and knowledge of or interest in fine-tuning and using language models for applications.
- Strong software-design instincts, including testing, code review, and CI/CD.
- Self-starter who is collaborative and low-ego.
Benefits
- Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal allowances, transportation allowances, and other location-specific perks.
Categories
About Mistral AI
Mistral AI builds foundation language models and full‑stack AI solutions for enterprises, offering APIs, on‑prem deployment, developer tools, and applications. The privately held company, founded in 2023 and headquartered in Paris, partners with organizations in finance, manufacturing, defense, healthcare, and the public sector to co‑create customized systems. It releases open‑source models alongside commercial offerings and makes its models available through major cloud marketplaces.