27 days ago
USA (city not specified)Senior
Base Salary
$127k - $254k/yr
Responsibilities
- Design and build production infrastructure for AI agent systems.
- Develop high-performance Rust services supporting model inference, orchestration, and execution.
- Architect scalable systems for millions of users and high request throughput.
- Build ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring.
- Define guardrails, observability, and failure handling for agent-driven workflows.
- Optimize inference and orchestration layers for latency, throughput, and cost.
- Partner with the Agent Systems team to harden experimental prototypes for production.
- Contribute to foundational infrastructure decisions in a high-scale environment.
Requirements
- 5+ years of experience building and operating high-scale production systems.
- Strong proficiency in Rust and systems-level programming.
- Deep understanding of distributed systems, reliability engineering, and performance optimization.
- Experience operating services serving millions of users or supporting high-throughput workloads.
- Familiarity with ML infrastructure, model serving, or MLOps in production environments.
- Experience designing observability, monitoring, and failure-recovery systems.
- Strong collaboration skills across infrastructure and applied engineering teams.
- Experience with agent-based or LLM-powered systems is preferred.
- Background in high-performance networking, async systems, or low-latency architectures is preferred.
- Experience with container orchestration and cloud-native infrastructure is preferred.
- Familiarity with evaluation frameworks and model performance monitoring at scale is preferred.
- Experience in fast-moving 0→1 or platform-building teams is preferred.
Tech Stack
Categories
About Kraken
Kraken builds a global digital asset trading platform for individuals and institutions, offering spot, margin, futures, staking, OTC, and related infrastructure. The company generates revenue primarily from trading and financing fees and institutional services. Founded in 2011 and operated by privately held Payward, it is remote-first and serves customers worldwide; it has published cryptographic Proof of Reserves since 2014 to verify client asset holdings.