4 months ago
Responsibilities
- Architect, build, and refine high-performance streaming infrastructure for large-scale, real-time merchant analytics.
- Develop tools and frameworks that improve platform efficiency, scalability, and developer experience.
- Collaborate with cross-functional teams to integrate streaming systems with Shopify’s broader data ecosystem.
- Partner with product and data teams to influence the technical roadmap and shape merchant analytics.
- Mentor and uplevel engineers while fostering technical excellence and innovation.
Requirements
- Extensive experience building and scaling real-time data infrastructure and platforms.
- Strong knowledge of Apache Flink or similar stream-processing frameworks such as Kafka Streams or Spark Streaming.
- Proficiency in multiple programming languages, with Java and SQL required; Python and Ruby are advantageous.
- Experience with analytical databases such as ClickHouse or BigQuery.
- Strong understanding of Docker and Kubernetes.
- Deep expertise in distributed-systems challenges including late-arriving data, exactly-once semantics, backfill strategies, and data consistency.
- Outstanding problem-solving skills for complex technical challenges at scale.
- Ability to collaborate effectively in a diverse, dynamic team environment.
Tech Stack
Categories
Data Engineering
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers