8 hours ago
Responsibilities
- Lead the architecture, design, and implementation of enterprise data platforms using object storage and Apache Iceberg.
- Develop and execute migration strategies for moving data from relational databases, data warehouses, and Hadoop ecosystems into Iceberg-based architectures.
- Design scalable batch, streaming, and near-real-time ingestion frameworks.
- Design Iceberg catalogs, namespaces, partitioning strategies, schema evolution, and data lifecycle management practices.
- Establish practices for security, metadata management, retention, regulatory compliance, governance, and lineage.
- Collaborate with application teams, data engineers, DBAs, and platform teams to assess migration readiness and modernize legacy workloads.
- Optimize data models across Bronze, Silver, and Gold lakehouse layers.
- Evaluate data access, query performance, and interoperability across Spark, Trino, Databricks, Snowflake, Teradata, and similar compute engines.
- Guide the conversion of ETL workloads and legacy data integration processes into modern data engineering frameworks.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field.
- At least 5 years of experience in Data Architecture, Data Engineering, or Data Platform modernization.
- At least 2 years of hands-on experience implementing Apache Iceberg in enterprise environments.
- Experience migrating large-scale datasets from traditional databases and data warehouses into object storage and lakehouse architectures.
- Strong understanding of object storage technologies, including S3-compatible platforms and Pure Storage.
- Experience implementing and managing Iceberg catalogs.
- Expertise in data modeling, partitioning strategies, schema evolution, metadata management, and performance optimization.
- Experience designing and implementing enterprise ETL architectures.
- Strong understanding of data governance, security, lineage, and compliance requirements.
- Understanding or experience with Postgres databases.
Tech Stack
Categories
Data Engineering
About EXL
EXL provides data analytics, AI, and digital operations services for enterprises in insurance, healthcare, banking, and other regulated industries. It delivers consulting, managed services, and technology platforms to improve decision-making, risk management, and operational efficiency. Founded in 1999 and headquartered in New York, EXL is a public company listed on the NASDAQ (ticker: EXLS).