AI infrastructure Engineer (SRE) Bangalore
Together AIResponsibilities
- Participate in an on-call PagerDuty rotation and respond to availability-impacting incidents.
- Build and operate infrastructure with Ansible, Terraform, and Kubernetes to support massive concurrent-user scale.
- Build monitoring systems to maintain high service quality.
- Design and implement operational processes such as deployments and upgrades.
- Debug production issues across services and stack levels.
- Identify product architecture improvements related to reliability, performance, and availability.
- Plan the growth of Together AI’s infrastructure.
Requirements
- 7+ years of professional SRE or related experience.
- Experience operating GPU-enabled Kubernetes clusters or AI infrastructure supporting machine learning training and inference workloads.
- Bachelor’s degree in Computer Science or a related field, or equivalent work experience.
- Expert knowledge of Ansible, including roles and playbooks, Terraform, and Kubernetes.
- Proficiency in programming and scripting languages.
- Direct experience with monitoring and observability practices.
- Advanced knowledge of cloud services.
- Ability to collaborate with different stakeholders and subject matter experts.
Benefits
- Remote India or based near Bangalore.
Tech Stack
Categories
About Together AI
Together AI is the AI Native Cloud, purpose-built for AI engineers and researchers with a full suite of tooling across inference, model shaping, and pre-training. AI natives can use Together AI as a full-stack AI platform — from a high- performance inference engine built for reliable and fast scaling to on-demand GPU clusters and massive-scale AI factories. Together AI continuously pushes the frontier forward by productizing cutting-edge research from our world-leading AI systems research team. By combining research velocity with production-grade infrastructure, we enable companies to reliably scale AI-native applications as fast as the field evolves. Trusted by leading AI natives like Cursor, Decagon, Eleven Labs, AI21, Hedra, and Cartesia, as well as SaaS innovators such as Salesforce, Zoom, and Zomato, Together AI powers the next generation of AI-native applications.