Member of Technical Staff (AI Infrastructure Engineer)
Perplexity3 months ago
London, United KingdomMid Level / Senior
H1B Sponsor
Responsibilities
- Design, deploy, and maintain scalable Kubernetes clusters for AI workloads.
- Manage and optimize Slurm-based HPC environments for distributed training.
- Develop robust APIs and orchestration systems for training and inference.
- Implement resource scheduling and job management systems.
- Benchmark system performance and diagnose bottlenecks.
- Build monitoring and observability solutions for ML workloads.
- Respond to system outages and maintain high uptime for services.
- Optimize cluster utilization and implement autoscaling strategies.
Requirements
- Strong expertise in Kubernetes administration and cluster management.
- Hands-on experience with Slurm workload management and optimization.
- Experience with deploying distributed training systems at scale.
- Deep understanding of container orchestration and distributed systems.
- Familiarity with LLM architecture and training processes.
- Experience managing GPU clusters and optimizing resource utilization.