Principal Engineer - Data Engineering
Western Digital2 days ago
Singapore, SingaporeStaff+
Responsibilities
- Build and maintain reliable, versioned feature engineering pipelines that transform engineering, sensor, and operational data into ML-ready feature sets.
- Design and operate data quality checks for completeness, schema consistency, statistical distribution stability, and label accuracy across AI training datasets.
- Maintain training-data versioning, lineage tracking, reproducibility, and deployment-data drift detection.
- Implement data contracts, access controls, retention practices, and governance standards for AI data assets.
- Contribute to real-time sensor-data ingestion and progressively assume operational ownership over 6–12 months.
- Build infrastructure for synthetic-data generation, ingestion, storage, and versioning.
- Maintain the training dataset registry, feature store, and model-input validation layer integrated with the AI platform.
Requirements
- Bachelor's or Master's degree in AI, Computer Science, Data Engineering, Electrical Engineering, Applied Mathematics, or a related field; an AI major is preferred.
- Fresh to 1 year of experience, with academic, personal, or internship project experience building end-to-end data pipelines accepted as the primary evaluation criterion.
- Strong, demonstrable Python and SQL proficiency, including complex queries, window functions, and data transformation logic.
- Knowledge of batch pipeline architecture, reliability, schema management, fault tolerance, and orchestration using tools such as Airflow, Prefect, or AWS Glue Jobs.
- Understanding of data quality checks, data versioning, lineage, reproducibility, train/test leakage, and label-quality effects on model performance.
- Preferred experience or knowledge includes Feast, Tecton, synthetic data generation, dbt, DLT, annotation platforms, MES/LIMS integration, active learning loops, and data lakehouse technologies.
Benefits
- Work location: Singapore office.
Tech Stack
Categories
Data Engineering
About Western Digital
Western Digital designs and manufactures data storage devices and platforms, including hard disk drives and solid-state drives, for consumer electronics, enterprises, and hyperscale data centers. The public company, founded in 1970 and headquartered in San Jose, sells under the Western Digital and SanDisk brands through OEM and retail channels, and supplies cloud platforms and PC markets worldwide.