2 days ago
Responsibilities
- Shape the technical direction of Shopify’s Streaming Compute platform and lead cross-team initiatives from ambiguous problems to shipped outcomes.
- Improve Apache Flink pipeline development, engine performance, reliability, stability, and cost efficiency at scale.
- Debug and tune Apache Flink at the engine level across runtime, state, checkpointing, memory, and connectors.
- Contribute to Apache Flink and its ecosystem through code, FLIPs, reviews, or other open source involvement.
- Build developer-friendly platform infrastructure for streaming and batch data pipelines.
- Mentor senior engineers and lead through influence.
- Participate in the 24/7 on-call rotation.
Requirements
- Established expertise in Apache Flink, including operating it in production at scale and understanding its internals.
- Strong distributed systems fundamentals covering stream and batch processing semantics, storage and table formats, and resource management.
- Experience running data infrastructure on Kubernetes.
- Ability to lead through influence, set technical direction, mentor senior engineers, and drive cross-team initiatives.
- Care for developer experience, pragmatism, and building platforms that other engineers can use effectively.
- Openness to using AI to accelerate and improve daily work.
- Contribution to the Apache Flink or related open source ecosystem, or sufficient depth and interest to begin contributing.
Benefits
- Participation in Shopify’s 24/7 on-call rotation is part of the role.
- The interview process aims to be completed within 30 days, with candidates expected to interview within the week of applying.
- The interview process includes a live pair-programming session using the candidate’s own IDE.
Tech Stack
Apache FlinkKubernetes
Categories
Data EngineeringDevOps
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers