AI Infrastructure Engineer
Together AIBase Salary
$190k - $270k/yr
Responsibilities
- Participate in the PagerDuty on-call rotation and respond to production incidents.
- Build and operate infrastructure with Ansible, Terraform, and Kubernetes to support massive concurrent-user scale.
- Build monitoring systems to maintain high-quality customer service.
- Design and implement operational processes such as deployments and upgrades.
- Debug production issues across services and all levels of the stack.
- Identify product architecture improvements related to reliability, performance, and availability.
- Plan the growth of Together AI's infrastructure.
Requirements
- 5+ years of professional AI infrastructure or related experience.
- Bachelor's degree in Computer Science or a related field, or equivalent work experience.
- Knowledge of Ansible, including roles and playbooks, Terraform, and Kubernetes.
- Proficiency in programming and scripting languages.
- Direct experience with monitoring and observability practices.
- Knowledge of cloud services.
- Ability to collaborate with different stakeholders and subject matter experts.
Benefits
- Startup equity
- Health insurance
- Other competitive benefits
- Full-time position
Tech Stack
Categories
About Together AI
Together AI is the AI Native Cloud, purpose-built for AI engineers and researchers with a full suite of tooling across inference, model shaping, and pre-training. AI natives can use Together AI as a full-stack AI platform — from a high- performance inference engine built for reliable and fast scaling to on-demand GPU clusters and massive-scale AI factories. Together AI continuously pushes the frontier forward by productizing cutting-edge research from our world-leading AI systems research team. By combining research velocity with production-grade infrastructure, we enable companies to reliably scale AI-native applications as fast as the field evolves. Trusted by leading AI natives like Cursor, Decagon, Eleven Labs, AI21, Hedra, and Cartesia, as well as SaaS innovators such as Salesforce, Zoom, and Zomato, Together AI powers the next generation of AI-native applications.