Principal Engineer - Data Engineering
Western Digital9 days ago
Singapore, SingaporeStaff+
Responsibilities
- Build and maintain versioned feature engineering pipelines that transform engineering, sensor, and operational data into ML-ready feature sets.
- Design and operate data quality checks for completeness, schema consistency, statistical distribution stability, and label accuracy.
- Build training-data versioning and lineage systems for reproducible model training and detect drift between deployment and training data.
- Implement data contracts, access controls, retention practices, and agreed governance standards for AI data assets.
- Contribute to real-time sensor-data ingestion pipelines and progressively develop operational ownership over 6–12 months.
- Build pipeline infrastructure supporting synthetic data generation, ingestion, storage, and versioning.
- Build and maintain the training dataset registry, feature store, and model input validation integrated with the AI platform.
Requirements
- Bachelor's or Master's degree in AI, Computer Science, Data Engineering, Electrical Engineering, Applied Mathematics, or a related field; an AI major is preferred.
- At least 2–3 years of demonstrated project experience building end-to-end data pipelines, including academic, personal, or internship projects.
- Strong proficiency in Python and SQL, including complex queries, window functions, and data transformation logic.
- Knowledge of scalable batch pipeline architecture, reliability, schema management, fault tolerance, and pipeline orchestration using tools such as Airflow, Prefect, or AWS Glue Jobs.
- Understanding of data quality principles, data versioning, lineage, reproducibility, and ML data lifecycle risks such as train/test leakage and label quality.
- Preferred experience with feature stores, synthetic data generation, dbt, DLT, annotation platforms, MES/LIMS integrations, active learning data loops, and data lakehouse technologies.
Tech Stack
Categories
Data Engineering
About Western Digital
Western Digital designs and manufactures data storage devices and platforms, including hard disk drives and solid-state drives, for consumer electronics, enterprises, and hyperscale data centers. The public company, founded in 1970 and headquartered in San Jose, sells under the Western Digital and SanDisk brands through OEM and retail channels, and supplies cloud platforms and PC markets worldwide.