AI Infrastructure Engineer
Together AI5 months ago
Base Salary
$190k - $270k/yr
Responsibilities
- Participate in the PagerDuty on-call rotation and respond to production incidents.
- Build and operate infrastructure with Ansible, Terraform, and Kubernetes to support massive concurrent-user scale.
- Build monitoring systems to maintain high-quality customer service.
- Design and implement operational processes such as deployments and upgrades.
- Debug production issues across services and all levels of the stack.
- Identify product architecture improvements related to reliability, performance, and availability.
- Plan the growth of Together AI's infrastructure.
Requirements
- 5+ years of professional AI infrastructure or related experience.
- Bachelor's degree in Computer Science or a related field, or equivalent work experience.
- Knowledge of Ansible, including roles and playbooks, Terraform, and Kubernetes.
- Proficiency in programming and scripting languages.
- Direct experience with monitoring and observability practices.
- Knowledge of cloud services.
- Ability to collaborate with different stakeholders and subject matter experts.
Benefits
- Startup equity
- Health insurance
- Other competitive benefits
- Full-time position
Tech Stack
Categories
DevOpsSite Reliability
About Together AI
Together AI builds an AI-native cloud platform for developers, offering high-performance inference, fine-tuning/model shaping, and large-scale pre-training on on-demand GPU clusters with APIs and managed services. It emphasizes open-source models that teams can run and adapt, and also provides infrastructure for decentralized and scalable workloads. Founded in 2022 and headquartered in San Francisco, it is privately held and reports notable customers including Cursor, ElevenLabs, Salesforce, and Zoom.