Senior Software Engineer - Together Cloud Platform
Together AI5 months ago
Base Salary
$160k - $230k/yr
Responsibilities
- Design and develop foundational backend services for Together AI’s cloud platform.
- Build and improve distributed GPU scheduling for the Instant Clusters product.
- Develop a global management plane for data-center compute, networking, and storage.
- Create customer-facing cloud platform services for enterprise AI workloads.
- Analyze and improve the robustness, scalability, and fault tolerance of distributed systems, APIs, databases, and infrastructure.
- Write tested, maintainable software and infrastructure as code.
- Conduct design and code reviews, create developer documentation, and develop testing strategies.
- Participate in an on-call rotation for critical incidents.
Requirements
- 5+ years of experience building large-scale, fault-tolerant distributed systems and API microservices.
- Experience improving the efficiency, scalability, and stability of system resources.
- Experience operating high-performance or globally distributed microservice architectures across AWS, Azure, or GCP.
- Strong knowledge of compute, networking, storage, concurrency, memory management, performant I/O, and scale.
- Experience developing against and managing relational databases such as PostgreSQL.
- Expert-level proficiency in at least one programming language, with Golang preferred.
- Proficiency with version-control practices and integrating infrastructure as code with CI/CD pipelines.
- Experience with Kubernetes and containers preferred.
- Experience with data infrastructure such as Kinesis, Airflow, or Kafka is a plus.
- Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience.
- Strong written and verbal communication skills for design documentation and cross-functional collaboration.
Benefits
- Remote-work flexibility
- Health insurance
- Startup equity
- Full-time position
Tech Stack
About Together AI
Together AI builds an AI-native cloud platform for developers, offering high-performance inference, fine-tuning/model shaping, and large-scale pre-training on on-demand GPU clusters with APIs and managed services. It emphasizes open-source models that teams can run and adapt, and also provides infrastructure for decentralized and scalable workloads. Founded in 2022 and headquartered in San Francisco, it is privately held and reports notable customers including Cursor, ElevenLabs, Salesforce, and Zoom.