3 hours ago
Remote, United StatesSenior
Responsibilities
- Design and build LLM-serving infrastructure on Kubernetes, including deployment, GPU scheduling, scaling, and model lifecycle management.
- Package the platform for enterprise environments with Helm-based installations, upgrades, and restricted or offline network support.
- Integrate the serving layer with the platform's API gateway, identity, and metering services.
- Build production observability for GPU inference, including serving metrics and GPU telemetry.
- Contribute across a multi-service codebase and help establish engineering direction through design documents and reviews.
Requirements
- 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
- Deep hands-on Kubernetes experience building and operating production workloads and Helm charts.
- Experience with GPU workloads or LLM inference, or strong adjacent systems experience with a track record of learning quickly.
- Strong Go programming skills and solid infrastructure-as-code skills.
- Fluency with AI-assisted development tools such as Claude Code and OpenAI Codex.
- Nice-to-have experience with inference performance work, distributed serving frameworks, enterprise deployments, air-gapped installations, SSO/OIDC, supply-chain security, React, TypeScript, or open-source contributions in Kubernetes or ML-infrastructure ecosystems.
Benefits
- Remote-first work environment with a written culture.
- Professional development and training.
- Opportunities to attend conferences and working groups.
- Company outings, happy hours, hackathons, and tech talks.
- Competitive compensation package with a strong benefits plan.
- Work on open-source innovation and next-generation cloud and AI infrastructure.
Tech Stack
Categories
About Mirantis
Mirantis builds Kubernetes-native infrastructure software and services for enterprises to run cloud, container, and AI workloads across on-premises, public cloud, and edge environments. It sells subscriptions, support, and managed services around products like Mirantis Kubernetes Engine and the Lens Kubernetes platform; the company acquired Docker Enterprise in 2019. Founded in 1999 and headquartered in Campbell, California, Mirantis is privately held and an IREN company serving global enterprises.