14 hours ago
Responsibilities
- Design, build, and operate high-throughput streaming pipelines processing behavioral event data at massive scale.
- Ensure event data is correctly enriched, routed, and made available to downstream consumers in compliance with privacy and governance requirements.
- Improve pipeline reliability, observability, latency, memory usage, Kafka throughput, and operational health.
- Collaborate with personalization, analytics, advertising, and other downstream teams to evolve the platform.
- Participate in on-call rotations and own the operational health of production systems.
- Work on complex pipeline functions including aggregations, rollups, and enrichment.
Requirements
- Proven experience building and operating high-throughput data processing systems in production at meaningful scale.
- Proficiency in Java or a similar JVM or statically typed language such as Kotlin, Scala, Go, or Rust.
- Hands-on experience with Apache Flink or a comparable stream-processing framework such as Dataflow or Spark Streaming.
- Working knowledge of Apache Kafka, including producing, consuming, throughput tuning, and operational behavior under load.
- Production on-call experience and an operational mindset focused on latency, memory, and running production systems.
- Familiarity with Kubernetes in a production context, including running workloads and owning their reliability.
- Experience with behavioral or event data pipelines, observability through metrics, alerting and tracing, latency or compression optimization, and complex pipeline processing is strongly valued.
- Interest or experience in data privacy, consent, governance, and compliance at the processing layer is a plus.
Tech Stack
Categories
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers