20 hours ago
Responsibilities
- Architect, optimize, and own Shopify’s production ML inference systems for high throughput, low latency, and global reliability.
- Extend CUDA, TensorRT, Triton, TVM, and custom GPU kernels to improve inference performance and efficiency at scale.
- Deploy, benchmark, and scale models in partnership with ML, infrastructure, and product teams.
- Reduce cloud spend and carbon footprint while preserving model quality.
- Investigate performance issues and apply pruning, quantization, distillation, batching, and other optimization techniques.
- Set technical strategy and culture for ML inference and mentor engineers.
Requirements
- Hands-on experience building and optimizing large-scale ML inference systems with measurable performance and cost improvements.
- Deep experience with production model serving, runtime optimization, GPU acceleration, and high-performance deep learning infrastructure.
- Strong software engineering skills in Python, C++, or other relevant languages, along with systems and distributed-computing expertise.
- Experience architecting or scaling reliable, real-time inference systems handling millions of queries per day.
- Experience collaborating with ML research or engineering, infrastructure, and product teams to deliver production results.
- Advanced understanding of model compression, quantization, efficient deployment, and speed, cost, and accuracy tradeoffs.
- Preferred qualifications include open-source contributions or technical publications, hardware optimization across NVIDIA, AMD, ARM, and cloud TPUs, inference monitoring and observability, autoscaling, modern MLOps pipelines, and large-scale product or e-commerce infrastructure experience.
Benefits
- Remote-first work arrangement.
- The hiring process targets completion of the interview loop within 30 days and requires a live pair-programming session using the candidate’s own IDE.
Categories
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers