Member of Technical Staff - Storage Infrastructure
Prime Intellect2 hours ago
San Francisco, CA, USAMid Level
Base Salary
$150k - $300k/yr
Responsibilities
- Design and operate storage architectures for training datasets, checkpointing, inference artifacts, and shared research workflows.
- Deploy and tune parallel filesystems, object storage, and local NVMe caching for demanding AI workloads.
- Benchmark throughput, latency, metadata performance, and concurrent access using representative training and checkpoint workloads.
- Build provisioning, capacity planning, lifecycle management, and operational automation for storage services.
- Design and test replication, recovery, backup, and failure-handling procedures against durability and availability targets.
- Diagnose performance and reliability issues across applications, clients, networks, filesystems, and devices.
- Implement access controls, tenant separation, quotas, monitoring, and runbooks while collaborating with compute and networking teams.
- Work directly with customers and engineering teams supporting large-scale AI infrastructure deployments.
Requirements
- At least 3 years of experience building or operating production distributed storage systems.
- Hands-on experience with at least one parallel or distributed filesystem or object storage platform, such as Lustre, BeeGFS, Ceph, or GPFS.
- Strong Linux administration and performance troubleshooting skills.
- Experience automating infrastructure operations with Python, Go, Bash, or similar languages.
- Understanding of storage failure modes, data integrity, consistency, replication, and recovery.
- Knowledge of block, file, and object storage semantics and performance tradeoffs.
- Experience with NVMe/SSD performance, filesystem tuning, I/O profiling, and benchmarking.
- Knowledge of high-throughput storage networking, distributed client behavior, capacity forecasting, observability, alerting, and safe maintenance procedures.
- Knowledge of authentication, authorization, encryption, and secure data lifecycle management.
- Preferred experience supporting large GPU training clusters and high-volume checkpoint workloads; S3-compatible object storage, data tiering, distributed caching, RDMA-enabled storage, GPUDirect Storage, Kubernetes storage integrations, SLURM environments, storage cost optimization, or open-source storage contributions.
Benefits
- Cash compensation is $150,000–$300,000 plus equity incentives.
Tech Stack
Categories
About Prime Intellect
Prime Intellect builds a full-stack platform for training frontier AI models, giving enterprises access to distributed compute and agentic training infrastructure to develop their own systems. The company operates as a platform and open research lab, with customers leveraging its infrastructure rather than building it in-house. Headquartered in San Francisco and privately held, it has raised a Series A round backed by investors including Founders Fund and NVIDIA.