Together Cloud Infrastructure Engineer
Together AI5 months ago
Amsterdam, NetherlandsSenior
Responsibilities
- Design, build, and maintain secure, performant, highly available backend services and operators for hardware management, storage provisioning, and VM provisioning.
- Build the IaaS software layer for a new GB200 data center containing thousands of GPUs.
- Develop and operate a global, multi-exabyte high-performance object store for massive pretraining datasets.
- Build customer observability systems and automated node lifecycle management for fault-tolerant distributed pretraining.
- Perform architecture and research work for decentralized AI workloads and contribute to the open-source Together AI platform.
- Create infrastructure services, tools, developer documentation, and testing frameworks for robustness and fault tolerance.
Requirements
- At least 5 years of professional software development experience and proficiency in at least one backend programming language, with Golang preferred.
- At least 5 years of experience writing high-performance, well-tested, production-quality code.
- Experience building and operating high-performance or globally distributed microservice architectures across AWS, Azure, or GCP.
- Strong systems knowledge and troubleshooting ability across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale.
- Experience with infrastructure automation using Terraform or Ansible, monitoring and observability using Prometheus or Grafana, and CI/CD pipelines using GitHub Actions or ArgoCD.
- Deep Kubernetes internals experience, virtualization and hypervisor experience, data-center networking experience, Cluster API or similar experience, and high-performance compute, networking, or storage experience are advantageous.
- Experience virtualizing GPUs or InfiniBand, working with DPUs or SmartNICs, building IaaS or PaaS systems at scale, and knowledge of GPU programming, NCCL, or CUDA are advantageous.
- Excellent communication skills and the ability to write clear design documents and collaborate with technical and non-technical colleagues.
Benefits
- Hybrid work arrangement with two days per week in the Amsterdam office.
Tech Stack
About Together AI
Together AI builds an AI-native cloud platform for developers, offering high-performance inference, fine-tuning/model shaping, and large-scale pre-training on on-demand GPU clusters with APIs and managed services. It emphasizes open-source models that teams can run and adapt, and also provides infrastructure for decentralized and scalable workloads. Founded in 2022 and headquartered in San Francisco, it is privately held and reports notable customers including Cursor, ElevenLabs, Salesforce, and Zoom.