10607 - Senior Data Engineer (Python)
Hyundai AutoEver America3 months ago
Irvine, CA, USASenior
Base Salary
$97k - $138k/yr
Responsibilities
- Design, develop, and maintain scalable Python-based data pipelines for data ingestion, processing, and transformation.
- Build and manage Apache Airflow workflows, including scheduling, monitoring, alerting, and production troubleshooting.
- Implement Bronze, Silver, and Gold Medallion Architecture data layers for data processing, governance, and analytics.
- Develop ETL/ELT solutions for databases, APIs, flat files, streaming sources, and third-party systems.
- Create reusable Python frameworks and libraries for ingestion, transformation, validation, and monitoring.
- Apply data quality checks, validation rules, and reconciliation processes to ensure data accuracy and reliability.
- Optimize pipelines for performance, scalability, fault tolerance, and cost efficiency, and perform root cause analysis and tuning for production workloads.
- Design and maintain data models supporting analytics, reporting, and machine learning use cases.
- Collaborate with cross-functional teams to translate business requirements into scalable technical solutions.
- Implement automation, CI/CD, version control, testing, monitoring dashboards, alerts, and operational metrics for data engineering workflows.
- Ensure adherence to data governance, security, compliance, and metadata management standards.
- Document data architectures, pipeline designs, transformation logic, and operational procedures.
- Support master data management, reference data management, and enterprise data integration initiatives.
Requirements
- 7+ years of experience in data warehouse or master data management applications.
- Bachelor's degree in computer science, information technology, or a related field.
- Extensive knowledge of SQL and experience with relational databases.
- Strong programming and scripting skills, including Python and PL/SQL.
- Hands-on experience developing ETL/ELT data pipelines and supporting production data workloads.
- Preferred experience implementing Lakehouse architectures and Bronze/Silver/Gold Medallion data models.
- Preferred experience with cloud-based data platforms such as Azure Data Lake, AWS, or GCP.
- Preferred familiarity with Spark/PySpark and distributed data processing frameworks.
- Preferred experience with Git, CI/CD pipelines, and DevOps practices.
- Preferred experience designing reusable frameworks for data ingestion, transformation, validation, and monitoring.
- Preferred familiarity with data governance, security, compliance, metadata management, master data management, or reference data management standards.
Benefits
- Comprehensive medical and dental coverage.
- Generous paid time off.
- Education assistance.
- Annual merit increase eligibility.
- Growth-focused work environment with learning and development opportunities.
- Position located in Irvine, California.
Tech Stack
Categories
Data Engineering
About Hyundai AutoEver America
Hyundai AutoEver America provides IT services and software for Hyundai Motor Group companies across North America, covering applications, infrastructure, connected-car platforms, and cybersecurity. The Irvine, California-based affiliate, founded in 2005, supports brands such as Hyundai, Kia, and Genesis as well as group units like Mobis, Glovis, and Hyundai Capital. Its business model centers on delivering internal consulting, integration, and managed services that link North American operations with Hyundai’s global systems.