15 hours ago
Responsibilities
- Architect, optimize, and own Shopify’s production ML inference systems for high throughput, ultra-low latency, and global reliability.
- Use CUDA, TensorRT, Triton, TVM, and custom GPU kernels to improve inference performance and efficiency at scale.
- Partner with ML, infrastructure, and product teams to deploy, benchmark, and scale production models.
- Reduce cloud costs and carbon footprint while maintaining model quality.
- Investigate performance and implement pruning, quantization, distillation, batching, and other model-serving optimizations.
- Set technical strategy and culture for ML inference across Shopify while mentoring others and collaborating with global AI experts.
Requirements
- Proven hands-on expertise building and optimizing large-scale ML inference systems with measurable performance and cost improvements.
- Deep experience with production model serving, runtime optimization, acceleration, GPUs, CUDA, TensorRT, and high-performance deep learning infrastructure.
- Strong software engineering skills in Python, C++, or other relevant languages, with a systems and distributed-computing mindset.
- Experience architecting or scaling reliable real-time inference systems handling millions of queries per day.
- Demonstrated cross-functional impact with ML research or engineering, infrastructure, and product teams.
- Advanced understanding of model compression, quantization, efficient deployment, and speed, cost, and accuracy tradeoffs.
- Preferred qualifications include open-source contributions to inference frameworks such as TensorRT, TVM, Triton, DeepSpeed, or ONNX; experience with NVIDIA, AMD, ARM, or cloud TPUs; familiarity with monitoring, observability, autoscaling, and MLOps pipelines; and experience with e-commerce or globally distributed inference workloads.
Benefits
- Remote-first work arrangement.
- Interview process is intended to be completed within 30 days, with candidates expected to interview within the week of applying.
- Live pair-programming interview requiring candidates to use their own IDE.
Categories
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers