1 day ago
Responsibilities
- Set the technical direction for Shopify’s Apache Flink-based Streaming Compute platform.
- Solve complex engine-level problems involving runtime, state, checkpointing, memory, connectors, performance, and reliability.
- Improve developer experience and self-service pipeline development for streaming and batch workloads.
- Operate and optimize data infrastructure at scale, including cost efficiency and stability.
- Contribute to Apache Flink and its open source ecosystem through code, FLIPs, reviews, or related involvement.
- Mentor senior engineers and lead cross-team initiatives from ambiguous problems through delivery.
- Participate in a 24/7 on-call rotation.
Requirements
- Established expertise operating Apache Flink in production at scale, including knowledge of its runtime, state, checkpointing, memory model, and connectors.
- Ability to debug and tune Apache Flink at the engine level rather than only through its APIs.
- Strong distributed systems fundamentals covering stream and batch processing semantics, storage and table formats, resource management, and Kubernetes-based data infrastructure.
- Ability to lead through influence, set technical direction, mentor senior engineers, and drive cross-team initiatives.
- Care for developer experience, pragmatic platform design, and making sound decisions about tuning, rewriting, or upstreaming changes.
- Willingness to use AI to accelerate and improve daily work.
- Ability or willingness to contribute to the Apache Flink open source community.
Benefits
- Participation in a 24/7 on-call rotation.
- Interview process expected to be completed within 30 days, including a live pair programming session using the candidate’s own IDE.
Tech Stack
Apache FlinkKubernetes
Categories
Data EngineeringDevOps
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers