21 hours ago
Responsibilities
- Architect, optimize, and own production ML inference systems for throughput, latency, reliability, and scale.
- Extend CUDA, TensorRT, Triton, TVM, and custom GPU kernels to improve inference performance and efficiency.
- Partner with ML, infrastructure, and product teams to deploy, benchmark, and scale production models.
- Optimize cost, cloud usage, and carbon footprint while maintaining model quality.
- Investigate performance and implement model-serving improvements using pruning, quantization, distillation, and batching.
- Set technical strategy and culture for ML inference and mentor engineers.
Requirements
- Demonstrated hands-on expertise building and optimizing large-scale ML inference systems with measurable performance and cost improvements.
- Deep experience with production model serving, runtime optimization, GPU acceleration, and high-performance deep learning infrastructure.
- Strong software engineering skills in Python, C++, or other relevant languages, with systems and distributed-computing expertise.
- Experience architecting or scaling reliable, real-time inference systems handling millions of queries per day.
- Track record of cross-functional delivery with ML research or engineering, infrastructure, and product teams.
- Advanced understanding of model compression, quantization, efficient deployment, and speed-cost-accuracy tradeoffs.
- Preferred experience contributing to inference frameworks or presenting at AI conferences.
- Preferred experience optimizing inference across NVIDIA, AMD, ARM, or cloud TPU hardware.
- Preferred familiarity with monitoring, observability, autoscaling, MLOps pipelines, e-commerce, product infrastructure, or globally distributed inference.
Benefits
- Remote-first team and work environment.
- Hiring process is intended to be completed within 30 days, with interviews expected within the week of application.
- The interview process includes a live pair-programming session using the candidate’s own IDE.
Categories
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers