20 days ago
Remote, CyprusMid Level
Responsibilities
- Design, develop, and maintain on-premises infrastructure for scalable AI inference workloads, including GPU scheduling, model deployment pipelines, and data access patterns.
- Build and manage monitoring and observability tools, dashboards, alerts, and runbooks for model health and system performance.
- Collaborate with ML engineering and platform teams on AI workload architecture, inference runtime integration, and performance testing at scale.
- Operate and troubleshoot production Kubernetes clusters and develop automation and operational tooling.
- Support infrastructure and services across Kubernetes, Linux, networking, infrastructure-as-code, and CI/CD environments.
Requirements
- Strong understanding of Kubernetes architecture, including CNI, CSI, operators, ingress or gateway components, and control plane components.
- Hands-on experience operating and troubleshooting production Kubernetes clusters.
- Strong Linux and networking troubleshooting skills covering DNS, routing, firewalling, TLS, MTU, connectivity, and performance issues.
- Ability to develop automation and operational tooling using Python, Go, or Bash.
- Experience with Terraform, Ansible, or similar infrastructure-as-code and configuration-management tools.
- Experience with VictoriaMetrics, Grafana, or similar monitoring, alerting, and troubleshooting tools.
- Strong experience with Git-based workflows and CI/CD pipelines.
- Preferred qualifications include familiarity with Cluster API, operation or administration of Slurm clusters, Argo CD, GitOps, Helm, Helmfile, managed platforms, PaaS, cloud services, bare metal, GPU, HPC, or high-performance computing environments.
- Nice-to-have qualifications include familiarity with the NVIDIA GPU stack, RDMA or InfiniBand, high-performance networking, OpenStack, and Kubernetes operator or controller development.
Benefits
- Competitive compensation.
- Flexible working hours and hybrid or remote options depending on the role.
- Work from anywhere in the world for up to 45 days per year.
- Private medical insurance for the employee and family, extra paid vacation and sick leave days, and support for important life events, with benefits varying by location.
- Language courses, modern offices with snacks and entertainment, and team sports and social activities, where applicable.
- Position available only under an employment (labor) agreement.
