Senior Software Engineer — Infra Agent Systems UK
Together AIResponsibilities
- Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across a large GPU fleet.
- Build distributed services, orchestration frameworks, knowledge graphs, and retrieval systems for infrastructure agents.
- Develop fleet intelligence systems combining telemetry, infrastructure state, operational knowledge, and historical incidents.
- Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through APIs.
- Own services end to end across architecture, implementation, testing, deployment, observability, and production operations.
- Improve agent performance through evaluations, retrieval improvements, better tools, and production feedback loops.
- Convert production agent learnings into reliable, reviewed software and automation.
Requirements
- 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms.
- Strong systems design skills and experience owning significant systems from design through production.
- Depth in AI agent systems, orchestration, tool use, evaluation, grounding, knowledge graphs, graph data modeling, search, retrieval, ranking, RAG, or semantic search systems.
- Strong backend engineering experience with API design, service boundaries, data modeling, and complex-system integrations.
- Experience with Kubernetes, GitOps such as ArgoCD, infrastructure-as-code, and cloud platforms.
- Comfort working with Go, TypeScript, Python, or Rust.
- GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers is a plus.
- Graph databases, event-driven systems, messaging platforms such as NATS or Kafka, and observability platforms such as Prometheus and Grafana are plus qualifications.
- Experience building evaluation frameworks or improving the quality and reliability of LLM-powered systems is a plus.
Benefits
- Remote-based in the UK.
- Opportunity to build foundational systems from the ground up and work on infrastructure at massive scale.
- Opportunity to shape self-improving AI agents operating real-world AI infrastructure.
Tech Stack
Categories
About Together AI
Together AI is the AI Native Cloud, purpose-built for AI engineers and researchers with a full suite of tooling across inference, model shaping, and pre-training. AI natives can use Together AI as a full-stack AI platform — from a high- performance inference engine built for reliable and fast scaling to on-demand GPU clusters and massive-scale AI factories. Together AI continuously pushes the frontier forward by productizing cutting-edge research from our world-leading AI systems research team. By combining research velocity with production-grade infrastructure, we enable companies to reliably scale AI-native applications as fast as the field evolves. Trusted by leading AI natives like Cursor, Decagon, Eleven Labs, AI21, Hedra, and Cartesia, as well as SaaS innovators such as Salesforce, Zoom, and Zomato, Together AI powers the next generation of AI-native applications.