3 months ago
Hong Kong, Hong KongStaff+
Responsibilities
- Mentor and coach data engineers while providing technical guidance and fostering a high-performing team culture.
- Design, develop, manage, monitor, and optimize scalable data pipelines for extraction, transformation, loading, and integration.
- Design schemas and data mappings across source systems, transactional databases, and application databases.
- Implement data cleansing, enrichment, transformation, validation, and quality-control processes for batch and real-time data.
- Lead end-to-end data architecture and platform improvements based on business requirements.
- Deploy and integrate Azure Data Services using DevOps tools, CI/CD pipelines, and integrated unit tests.
- Monitor pipeline performance, troubleshoot issues, and identify opportunities to improve data flow and infrastructure.
- Create and maintain documentation for data pipelines, processes, and configurations.
- Ensure data governance, privacy, compliance, accuracy, and integrity throughout the data lifecycle.
- Collaborate with data engineers, analysts, data scientists, architects, business leads, and technical stakeholders.
Requirements
- Bachelor’s degree in computer science, information technology, or a related field; a master’s degree is a plus.
- 10+ years of experience as a Data Engineer implementing and maintaining data pipelines, scheduling, monitoring, notifications, and ETL processes.
- Experience with Azure Data Factory, Databricks, Python/PySpark, Java, and Scala.
- Understanding of Azure infrastructure, including subscriptions, resource groups, resources, RBAC, Azure AD integrations, security principles, VNets, subnets, NSG rules, private endpoints, and credential and key management.
- Experience deploying and integrating Azure Data Services with GitHub repositories, Jenkins CI/CD pipelines, and integrated unit tests.
- Knowledge of Azure Data Lake Storage Gen2, blob-storage topology, storage accounts, containers, folders, and file hierarchies.
- Proficiency in data mart fact and dimension design, ETL/ELT upsert and Type 2 logic, Python/PySpark, stored procedures, SQL, ADLS lakehouse architectures, Databricks, and Azure Synapse dedicated SQL pools.
- Preferred experience with LLM and AI tools, Unity Catalog, and Power BI reporting and semantic-layer capabilities.
- Understanding of data privacy, compliance regulations, and standard methodologies.
- Strong problem-solving, communication, collaboration, organizational, and quality-focused skills.
Benefits
- Hybrid working arrangement.
- Flexible environment supporting learning, career growth, well-being, and inclusion.
- Equal opportunity employment and reasonable accommodation support during the application process.
About Manulife
Manulife is a Toronto‑headquartered public financial services company that provides life and health insurance, retirement plans, and wealth and asset management to individuals and institutions. It earns premiums and fee income from insurance, investment, and advisory products delivered across Canada, Asia, and Europe, and operates as John Hancock in the United States. Founded in 1887, the company is listed on the Toronto Stock Exchange.