2 months ago
Guangzhou, ChinaStaff+
Responsibilities
- Lead end-to-end delivery of big data ETL and scoring pipelines from design through production support.
- Design and evolve scalable cloud-native architectures on GCP.
- Develop and optimize Spark and Scala jobs for large-scale batch processing, data quality, enrichment, and scoring outputs.
- Drive integration patterns and engineering standards for the Quantexa platform, including data ingestion and entity-resolution workflows.
- Design indexing and retrieval patterns using Elastic Search for investigative and analytical use cases.
- Establish engineering practices for code quality, testing, observability, reliability, and cost-performance optimization.
- Mentor engineers, conduct technical reviews, and guide teams through solution design and delivery.
Requirements
- Strong hands-on experience building production-grade big data engineering, ETL pipelines, and data platforms at scale.
- Advanced Spark and Scala experience, including performance tuning, partitioning, skew handling, job optimization, and production support.
- Strong experience designing and running data workloads on GCP, including Dataproc, GCS, CloudSQL, GKE or containers, IAM and security basics, and networking considerations.
- Technical leadership experience covering solution design ownership, estimation and planning, delivery guidance, mentoring, and setting engineering standards.
- Strong fundamentals in distributed systems, data modeling, batch processing, fault tolerance, testing, and CI/CD practices.
- Strong stakeholder and communication skills, including translating technical topics for non-technical partners and driving outcomes across teams.
Benefits
- Flexible working arrangements.
- Opportunities for continuous professional development and career growth.
- Inclusive and diverse workplace with equal-opportunity employment practices.
Tech Stack
Categories
Data Engineering
About HSBC
HSBC is a global bank that provides retail, commercial and investment banking, payments, and wealth management to individuals, SMEs, and multinationals. It earns fees, interest income, and trading revenues through branches and digital platforms across major markets. Headquartered in London, it serves over 40 million customers in 58 countries and is listed in London, Hong Kong, New York, and Bermuda.