6 months ago
Responsibilities
- Build and operate ML control planes, APIs, CLIs, SDKs, and self-service golden paths.
- Design and optimize multi-tenant GPU Kubernetes clusters, including autoscaling, scheduling, packing, and utilization.
- Own model lifecycle workflows covering training orchestration, experiments, registries, versioning, deployment, canary releases, blue-green deployments, and rollback.
- Build real-time serving stacks and end-to-end batch and streaming pipelines.
- Design feature platforms and engineer storage and data movement for datasets, features, and artifacts.
- Implement observability and SLOs across ML pipelines, training, and inference, including automated remediation and capacity planning.
- Partner with ML, data, and product teams to accelerate delivery.
Requirements
- Proven platform or infrastructure engineering experience shipping production systems and code.
- Deep Kubernetes and containerization expertise for ML workloads, including operators, Helm, service mesh, gRPC, and multi-tenant clusters.
- Hands-on experience running GPU infrastructure at scale, including NVIDIA-based scheduling, packing, and optimization.
- Strong distributed-systems and API/service-design fundamentals, with experience supporting high-scale inference.
- Proficiency with infrastructure-as-code and automation using Terraform and Helm on GCP, AWS, or Azure.
- Observability expertise with Prometheus and Grafana, plus SLO-driven operations for ML systems.
- Proficiency in Python, Go, or Java and experience building developer tooling and self-service platforms.
- Preferred experience with KServe, Seldon, TensorFlow Serving, Kubeflow, MLflow, Weights & Biases, model registries, DVC, Feast, Tecton, Kafka, Spark, Flink, Redis, MySQL, experimentation platforms, online evaluation, and model performance optimization.
Benefits
- The role may require on-call work.
- Applicants should be prepared to interview within one week, with a goal of completing the interview loop within 30 days.
- The interview process includes a live pair-programming session using the applicant’s own IDE.
Tech Stack
Apache FlinkApache KafkaApache SparkAWSAzureDVCGoGoogle Cloud PlatformGrafanagRPCHelmJavaKubernetesMLflowMySQLPrometheusPythonRedisTerraform
Categories
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers