Research Engineer, Data Infrastructure
Mistral AI2 months ago
Palo Alto, CA, USA or San Francisco, CA, USAMid Level
Responsibilities
- Build and scale distributed compute and storage systems.
- Architect and maintain multi-cluster orchestration layers across hardware and regions.
- Design migration to modern, columnar storage formats for large-scale fine-tuning datasets.
- Develop the internal training platform across Kubernetes- and SLURM-based environments.
- Implement metadata and data/model lineage systems.
- Manage cloud-native deployments and participate in on-call rotations for critical training jobs.
Requirements
- At least 4 years of experience in data infrastructure, MLOps, or infrastructure engineering.
- Experience or strong interest in foundational compute and storage platforms.
- Proficiency in Python and modern columnar storage standards.
- Experience with Kubernetes-native tooling and debugging large-scale distributed systems across multi-cluster environments.
- Ability to build and operate scalable, reliable, and secure systems.
Benefits
- Benefits may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal allowances, transportation allowances, and other location-specific perks.
- Benefits vary by country and location.
Tech Stack
Categories
Data EngineeringDevOps
About Mistral AI
Mistral AI builds foundation language models and full‑stack AI solutions for enterprises, offering APIs, on‑prem deployment, developer tools, and applications. The privately held company, founded in 2023 and headquartered in Paris, partners with organizations in finance, manufacturing, defense, healthcare, and the public sector to co‑create customized systems. It releases open‑source models alongside commercial offerings and makes its models available through major cloud marketplaces.