Gcore

DevOps Engineer (AI Inference)

Gcore
Apply
2 months ago
Remote, CyprusMid Level

Responsibilities

  • Design, develop, and maintain on-premises infrastructure for scalable AI inference workloads, including GPU scheduling, model deployment pipelines, and data access patterns.
  • Build and manage monitoring and observability tools, dashboards, alerts, and runbooks for model health and system performance.
  • Collaborate with ML engineering and platform teams on AI workload architecture, inference runtime integration, and performance testing at scale.
  • Operate and troubleshoot production Kubernetes clusters and develop automation and operational tooling.
  • Support infrastructure and services across Kubernetes, Linux, networking, infrastructure-as-code, and CI/CD environments.

Requirements

  • Strong understanding of Kubernetes architecture, including CNI, CSI, operators, ingress or gateway components, and control plane components.
  • Hands-on experience operating and troubleshooting production Kubernetes clusters.
  • Strong Linux and networking troubleshooting skills covering DNS, routing, firewalling, TLS, MTU, connectivity, and performance issues.
  • Ability to develop automation and operational tooling using Python, Go, or Bash.
  • Experience with Terraform, Ansible, or similar infrastructure-as-code and configuration-management tools.
  • Experience with VictoriaMetrics, Grafana, or similar monitoring, alerting, and troubleshooting tools.
  • Strong experience with Git-based workflows and CI/CD pipelines.
  • Preferred qualifications include familiarity with Cluster API, operation or administration of Slurm clusters, Argo CD, GitOps, Helm, Helmfile, managed platforms, PaaS, cloud services, bare metal, GPU, HPC, or high-performance computing environments.
  • Nice-to-have qualifications include familiarity with the NVIDIA GPU stack, RDMA or InfiniBand, high-performance networking, OpenStack, and Kubernetes operator or controller development.

Benefits

  • Competitive compensation.
  • Flexible working hours and hybrid or remote options depending on the role.
  • Work from anywhere in the world for up to 45 days per year.
  • Private medical insurance for the employee and family, extra paid vacation and sick leave days, and support for important life events, with benefits varying by location.
  • Language courses, modern offices with snacks and entertainment, and team sports and social activities, where applicable.
  • Position available only under an employment (labor) agreement.

Tech Stack

AnsibleArgo CDBashGitGoGrafanaHelmKubernetesLinuxOpenStackPythonTerraform

Categories

Gcore

About Gcore

501-1,000 employees

Gcore provides edge and cloud infrastructure for enterprises and service providers, including CDN, DNS, traffic management, security, and GPU cloud for AI workloads. It operates its own global network across six continents to deliver low-latency performance for media, gaming, and enterprise applications. Founded in 2014 and headquartered in Contern, Luxembourg, Gcore is privately held.

Contact me