6 days ago
Chengdu, ChinaMid Level
Responsibilities
- Design layered data warehouse models across ODS, DWD, DWS, and ADS and define metric specifications.
- Develop offline and near-real-time data pipelines with Hive, Spark, and Flink.
- Translate business reporting and metric requirements into reusable data models and data services.
- Establish data quality checks and resolve job failures, delays, reconciliation issues, inconsistent definitions, null values, and incremental or full-load concerns.
- Optimize SQL, jobs, storage, processing time, and computing costs.
- Schedule, deploy, monitor, and document production data jobs.
- Participate in Java project development.
Requirements
- Bachelor’s degree or above from a 985 or 211 university in computer science or a related major.
- At least 2 years of work experience.
- Strong SQL skills, including complex joins, window functions, and performance tuning.
- Proficiency in Python for maintainable ETL scripts and data-processing programs.
- Production experience with Spark, including PySpark or Spark SQL, partitioning, shuffle, and wide-table processing optimization.
- Familiarity with layered data warehouses and at least one common storage technology such as Hive, HDFS, or object storage.
- Familiarity with scheduling and operations tools such as Azkaban and the ability to troubleshoot failed jobs and data delays.
- Strong Java development skills and experience with Java projects preferred.
- Understanding of data quality practices including reconciliation, primary-key uniqueness, null handling, and incremental versus full-load strategies.
- Standard Mandarin, CET-4 or above, and the ability to read and communicate in English.
- AI development project experience preferred.
- Proactive, responsible, collaborative, and capable of cross-team communication.
Benefits
- Country-tailored elective benefits.
- Formal leadership and professional development programs and on-demand courses.
- Financial, physical, and mental well-being support through seminars, events, and the global Life Empowerment Assistance Program.
- Inclusive education, peer-to-peer conversations, and equitable growth and development opportunities.
- Onboarding and networking with new coworkers within the first 30 days.
- Internal peer-led communities, business resource groups, volunteering events, and environmental and social initiatives.
Tech Stack
Categories
Data Engineering
About TD SYNNEX
TD SYNNEX distributes IT hardware, software, and cloud services and aggregates solutions for technology vendors and resellers, including VARs and system integrators. It provides logistics, financing, cloud marketplaces, and professional services that help partners procure, bundle, and deploy technology for end customers. The public company (NYSE: SNX), headquartered in Fremont, California, was formed in 2021 through the merger of Synnex and Tech Data and operates globally.