1 day ago
Responsibilities
- Design and optimize large-scale batch jobs and pipelines that process petabytes of data across massive compute clusters.
- Build and operate authorization infrastructure, including policy engines, row-level security, credential vending, and fine-grained access controls.
- Develop abstractions that apply access controls consistently across heterogeneous storage and streaming systems.
- Own the engineering and operation of systems supporting data privacy, deletion, compliance, and responsible data handling.
- Manage or optimize large compute workloads and learn the security models of multiple data systems.
Requirements
- Strong data engineering fundamentals, including SQL, Java, and hands-on experience with large-scale compute frameworks such as Spark or Flink.
- Experience designing and optimizing pipelines that process very large datasets efficiently.
- Understanding of how data is stored and transformed at scale, including query and resource optimization.
- Comfort working across multiple storage and streaming systems and learning their security surfaces.
- Interest in data privacy and responsible data handling.
- Preferred experience with authorization frameworks such as RBAC, ABAC, row-level security, and credential vending.
- Preferred exposure to privacy engineering, data deletion, or compliance-driven data workflows.
- Preferred experience with Terraform, policy engines such as OPA/Rego or Cedar, infrastructure-as-code patterns, or large compute clusters.
Tech Stack
Categories
Data Engineering
About Shopify
Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more. Find all our jobs here: www.shopify.com/careers