20 days ago
Shanghai, ChinaSenior
Responsibilities
- Design and implement scalable data lake and warehouse solutions using Apache Iceberg.
- Develop batch and streaming data pipelines for ingestion, transformation, partitioning, and data quality.
- Optimize Iceberg storage layouts, file formats, metadata, query performance, joins, aggregations, and clustering.
- Collaborate with product managers, data analysts, and software engineers to create data models and reliable data services.
- Establish governance practices for schema evolution, retention, catalog management, and dataset quality.
- Implement workflow monitoring, metrics, logs, health checks, and alerting.
- Document data architecture, pipeline specifications, and operational procedures.
- Coordinate with security and compliance teams on access controls, encryption, and audit trails.
- Advise stakeholders on curated datasets and semantic layers and evaluate compatible data technologies.
Requirements
- Strong hands-on production experience with Apache Iceberg, including table design, partitioning, and snapshot management.
- Knowledge of data engineering concepts including ETL development, distributed processing, and data modeling.
- Practical experience with high-tech software products or digital platforms, including telemetry and user analytics patterns.
- Proficiency in English and Chinese Mandarin for documentation and stakeholder collaboration.
- Experience administering cloud or on-premises data infrastructure for secure and scalable analytical workloads.
- Familiarity with data governance and data quality frameworks.
- Preferred certifications include Apache Iceberg specialist training or a vendor data engineering certification, such as a cloud provider data engineer credential.
Benefits
- Fully on-site work from the office during regular day shifts.
- Opportunity to support global stakeholders and digital services in a high-tech product environment.
Categories
Data Engineering
About Cognizant
Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.