7 days ago
Chengdu, ChinaMid Level
Responsibilities
- Design layered data warehouse models across ODS, DWD, DWS, and ADS and define metric standards.
- Develop batch and near-real-time data pipelines using Hive, Spark, and Flink.
- Translate business reporting and metric requirements into reusable data models and data services.
- Build data quality checks and resolve job failures, delays, reconciliation issues, and inconsistent metric definitions.
- Optimize SQL, data jobs, and storage to reduce processing time and computing costs.
- Deploy scheduled jobs, monitoring, and documentation to maintain production data availability.
- Participate in Java project development.
Requirements
- Bachelor's degree or higher from a 985 or 211 university in computer science or a related field.
- At least two years of work experience.
- Proficiency in SQL, including complex joins, window functions, and performance optimization.
- Proficiency in Python for maintainable ETL scripts and data-processing programs.
- Production experience with Spark, including PySpark or Spark SQL, and knowledge of partitioning, shuffle, and wide-table processing optimization.
- Familiarity with layered data warehouses and at least one common storage technology such as Hive, HDFS, or object storage.
- Knowledge of scheduling and operations tools such as Azkaban, with the ability to troubleshoot failed jobs and data delays.
- Ability to explain data reconciliation, primary-key uniqueness, null handling, and incremental versus full-load strategies.
- Proficiency in Java development and Java project experience preferred.
- Standard Mandarin, CET-4 English or above, and the ability to read and communicate in English.
- AI development project experience is preferred.
- Strong initiative, responsibility, teamwork, and cross-team communication skills.
Benefits
- Elective benefits tailored to the employee's country and lifestyle.
- Formal leadership and professional development programs and on-demand courses.
- Financial, physical, and mental well-being seminars, events, and access to the global Life Empowerment Assistance Program.
- Diversity, equity, and inclusion education, peer conversations, and equitable growth opportunities.
- Onboarding that connects new coworkers within the first 30 days.
- Internal peer-led communities, business resource groups, volunteering events, and environmental and social initiatives.
Tech Stack
Categories
Data Engineering
About TD SYNNEX
TD SYNNEX distributes IT hardware, software, and cloud services and aggregates solutions for technology vendors and resellers, including VARs and system integrators. It provides logistics, financing, cloud marketplaces, and professional services that help partners procure, bundle, and deploy technology for end customers. The public company (NYSE: SNX), headquartered in Fremont, California, was formed in 2021 through the merger of Synnex and Tech Data and operates globally.