Data Platform Engineer
Hadrian Automationabout 4 hours ago
Los Angeles, CA, USAMid Level / Senior
Base Salary
$170k - $300k/yr
Responsibilities
- Build the data backbone for autonomous factories by transforming machine signals and quality events into trusted data.
- Develop ingestion, CDC, and streaming capabilities for various data types while managing ordering and retries.
- Define versioned data and event contracts with upstream teams, ensuring data freshness and correctness.
- Model operational data into datasets with explicit grain, identity, and history.
- Own orchestration, transformation, and observability of data workflows for machine learning applications.
- Collaborate with manufacturing operations to acquire data from machines and industrial protocols.
Requirements
- Experience in building and operating production data infrastructure or distributed data systems.
- Strong skills in production Python, advanced SQL, and data modeling.
- Familiarity with Kafka or other event-streaming platforms and stateful incremental pipelines.
- Experience with Snowflake and lakehouse formats like Iceberg or Delta.
- Proficiency in tools such as Dagster, Airflow, or Kubernetes.
Benefits
- Medical, dental, vision, and life insurance plans for employees.
- 401k retirement plan.
- Relocation support may be provided based on business needs.
- Flexible vacation policy.
- Equity options.
Tech Stack
Categories
AI & MLData Engineering