Kraken

Senior Software Engineer – AI Infrastructure

Kraken
Apply
3 hours ago
San José, Costa Rica or Tallinn, EstoniaSenior

Responsibilities

  • Design and build production infrastructure for AI agent systems.
  • Develop high-performance Rust services for model inference, orchestration, and execution.
  • Architect scalable systems supporting millions of users and high request throughput.
  • Build ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring.
  • Define guardrails, observability, and failure handling for agent-driven workflows.
  • Optimize latency, throughput, and cost across inference and orchestration layers.
  • Partner with the Agent Systems team to harden experimental prototypes for production.
  • Contribute to foundational infrastructure decisions in a high-scale environment.

Requirements

  • At least 5 years of experience building and operating high-scale production systems.
  • Strong proficiency in Rust and systems-level programming.
  • Deep understanding of distributed systems, reliability engineering, and performance optimization.
  • Experience operating services serving millions of users or handling high-throughput workloads.
  • Experience with ML infrastructure, model serving, or MLOps in production environments.
  • Experience designing observability, monitoring, and failure-recovery systems.
  • Strong collaboration skills across infrastructure and applied engineering teams.
  • High ownership mindset in high-stakes production environments.
  • Preferred experience with agent-based or LLM-powered systems, high-performance networking, asynchronous systems, low-latency architectures, container orchestration, cloud-native infrastructure, evaluation frameworks, and model-performance monitoring at scale.
  • Preferred experience working on fast-moving 0-to-1 or platform-building teams.

Tech Stack

Kraken

About Kraken

1,001-5,000 employees

Kraken builds a global digital asset trading platform for individuals and institutions, offering spot, margin, futures, staking, OTC, and related infrastructure. The company generates revenue primarily from trading and financing fees and institutional services. Founded in 2011 and operated by privately held Payward, it is remote-first and serves customers worldwide; it has published cryptographic Proof of Reserves since 2014 to verify client asset holdings.

Contact me