Together AI

Platform Engineer, Model Shaping

Together AI
Apply
3 months ago
San Francisco, CA, USAMid Level
H1B sponsor

Base Salary

$200k - $290k/yr

Responsibilities

  • Design and build systems and infrastructure for model customization, including user-facing features and internal improvements.
  • Improve platform reliability through on-call participation and incident-response process improvements.
  • Create and improve deployment, continuous-integration, and observability tooling.
  • Build a multi-datacenter job orchestration platform supporting heterogeneous hardware.
  • Partner with internal service teams to co-design and integrate services into Model Shaping systems.

Requirements

  • At least 3 years of experience building infrastructure or backend components for production services.
  • Extensive experience designing, operating, and troubleshooting production Linux environments and Kubernetes-based platforms.
  • Strong software engineering experience in Python or Go.
  • Experience with Terraform, Ansible, Prometheus, Grafana, GitHub Actions, and ArgoCD.
  • Cloud administration experience with AWS, GCP, or Azure, preferably across hybrid bare-metal and cloud environments.
  • Strong communication and documentation skills, with the ability to collaborate across varying levels of technical expertise.
  • Comfort operating across cluster operations, infrastructure automation, and backend service development.
  • Experience with large-scale reliable production systems, pipeline orchestration frameworks, GPU workloads on HPC clusters, AI training or inference deployments, networking fundamentals, or open-source projects is advantageous.

Benefits

  • Startup equity
  • Health insurance
  • Flexible remote-work options

Tech Stack

Categories

Together AI

About Together AI

201-500 employees

Together AI builds an AI-native cloud platform for developers, offering high-performance inference, fine-tuning/model shaping, and large-scale pre-training on on-demand GPU clusters with APIs and managed services. It emphasizes open-source models that teams can run and adapt, and also provides infrastructure for decentralized and scalable workloads. Founded in 2022 and headquartered in San Francisco, it is privately held and reports notable customers including Cursor, ElevenLabs, Salesforce, and Zoom.

Contact me