3 days ago
Responsibilities
- Architect the unified Iceberg platform and define API contracts and integration patterns.
- Own the metastore migration strategy and coordinate with multiple teams.
- Shape the object storage abstraction layer for ease of use and security.
- Lead compliance architecture by translating regulatory requirements into technical controls.
- Drive cost and efficiency improvements at petabyte scale through automated tooling.
- Set technical standards and mentor senior engineers in architectural decisions.
Requirements
- 10+ years of professional software engineering experience.
- Experience designing and operating large-scale distributed storage systems.
- Deep knowledge of object storage, including IAM and access control at petabyte scale.
- Proven ability to lead complex infrastructure projects with cross-team coordination.
- Strong background in authorization and access control design for distributed systems.
Tech Stack
Apache FlinkApache Spark