Western Digital

Principal Engineer - Data Engineering

Western Digital
Apply
18 days ago
Singapore, SingaporeStaff+

Responsibilities

  • Build and maintain reliable, versioned feature engineering pipelines for engineering, sensor, and operational data.
  • Design and operate data quality checks for completeness, schema consistency, statistical distribution stability, and label accuracy.
  • Maintain training data versioning and lineage tracking, including reproducibility and drift detection.
  • Implement data contracts, access controls, retention practices, and governance standards for AI data assets.
  • Contribute to real-time sensor data ingestion pipelines and progressively develop operational ownership over 6–12 months.
  • Build infrastructure for synthetic data generation, ingestion, storage, and versioning.
  • Maintain the training dataset registry, feature store, and model input validation layer integrated with the AI platform.

Requirements

  • A bachelor's or master's degree in AI, Computer Science, Data Engineering, Electrical Engineering, Applied Mathematics, or a related field is required, with an AI major preferred.
  • At least 2–3 years of demonstrated project experience building end-to-end data pipelines, including academic, personal, or internship projects.
  • Strong Python and SQL proficiency, including complex queries, window functions, and data transformation logic.
  • Knowledge of batch pipeline architecture, reliability, schema management, fault tolerance, and orchestration using tools such as Airflow, Prefect, or AWS Glue Jobs.
  • Understanding of data quality, data versioning, lineage, reproducibility, ML data lifecycles, train/test leakage, and label quality.
  • Preferred experience includes feature stores, synthetic data generation, dbt, DLT, annotation platforms, MES/LIMS integration, active learning data loops, and data lakehouse technologies.

Benefits

  • Work location is the Singapore office.
  • WD states that it is committed to an inclusive environment and provides accommodation support for applicants with disabilities.

Tech Stack

Amazon RedshiftApache AirflowAWSdbtElasticsearchKubernetesPythonSQL

Categories

Data Engineering
Western Digital

About Western Digital

10,000+ employees

Western Digital designs and manufactures data storage devices and platforms, including hard disk drives and solid-state drives, for consumer electronics, enterprises, and hyperscale data centers. The public company, founded in 1970 and headquartered in San Jose, sells under the Western Digital and SanDisk brands through OEM and retail channels, and supplies cloud platforms and PC markets worldwide.

Contact me