2 days ago
Responsibilities
- Design, build, and operate high-throughput streaming pipelines for behavioral event data at massive scale.
- Ensure event data is correctly enriched, routed, and made available in compliance with privacy, consent, and governance requirements.
- Improve pipeline reliability, observability, latency, memory efficiency, Kafka throughput, and operational health.
- Collaborate with downstream personalization, analytics, advertising, and other teams to evolve platform capabilities.
- Participate in on-call rotations and own the operational health of production systems.
- Develop complex pipeline capabilities such as aggregations, rollups, and enrichment.
Requirements
- Proven experience building and operating high-throughput data processing systems in production at meaningful scale.
- Proficiency in Java or a similar JVM or statically typed language such as Kotlin, Scala, Go, or Rust.
- Hands-on experience with Apache Flink or a comparable stream processing framework such as Dataflow or Spark Streaming.
- Working knowledge of Apache Kafka, including producing, consuming, throughput tuning, and operational behavior under load.
- Production operational experience, including on-call work and attention to latency, memory, and system reliability.
- Familiarity with Kubernetes in a production context.
- Strong signals include experience with behavioral or event data pipelines, observability, metrics, alerting, tracing, latency optimization, compression, aggregations, rollups, and enrichment.
- Interest or experience in data privacy and compliance at the processing layer is a plus.
- Experience at companies or platforms where behavioral data is a core product is a plus.
Benefits
- The hiring process aims to complete the interview loop within 30 days.
- Candidates should be prepared to interview within one week and complete a live pair programming session using their own IDE.
Tech Stack
Categories
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers