Senior Data Engineer, Data Analytics
Agility Robotics9 days ago
Base Salary
$175k - $274k/yr
Responsibilities
- Collaborate with robot software and hardware teams to define, collect, and curate data for analytics and debugging.
- Develop and maintain ETL pipelines that transform robot logs and telemetry into structured datasets using Apache Spark, Airflow or equivalent orchestration tools, and AWS data services.
- Own gold-layer datasets supporting fleet dashboards, reliability models, and business metrics, including freshness SLAs, documentation, and monitoring.
- Implement data quality checks, schema evolution, and metadata management using internal data registry and cataloging systems.
- Design efficient data models with reliability, analytics, and ML teams for their workflows.
- Contribute occasionally to shared Python, Java, or C++ libraries and APIs for data capture and consumption.
Requirements
- At least 5 years of experience building and maintaining production data pipelines as a Data Engineer or in a similar role.
- Strong proficiency with Apache Spark or an equivalent distributed data processing framework and complementary programming skills in Python, Java, and/or Scala.
- Experience with Airflow, Dagster, Prefect, or other data orchestration systems.
- Proficiency with Avro, Parquet, and structured or numeric datasets.
- Familiarity with table formats such as Apache Iceberg and Delta Lake and with medallion architecture.
- Understanding of data modeling, schema evolution, data quality practices, logical modeling, and physical partitioning for query performance.
- Experience or familiarity with analytical query engines and playback or root-cause-analysis tools such as ReRun and Foxglove.
- Comfort working cross-functionally with software, hardware, and analytics teams.
- Preferred experience with immutable dataset design, vision data pipelines, multimodal data processing, C++, data catalogs, and metadata management.
Benefits
- Fully remote role with the option to work hybrid from a commutable distance to offices in Salem, Oregon; Pittsburgh, Pennsylvania; or Fremont, California.
- 401(k) plan with a 6% company match, company stock options, and company-paid medical, dental, vision, and disability insurance.
- Benefits begin on the first day of employment, with an Employee Assistance Program.
- Exempt employees receive flexible unlimited PTO and 12 company holidays including a winter shutdown; non-exempt employees receive vacation, sick leave, and 12 company holidays.
- Catered lunches four times weekly and snacks are available at the Salem and Pittsburgh offices.
- Paid parental leave, flexible work arrangements, professional development, tuition reimbursement, eligible-role relocation assistance, and eligible-role annual discretionary bonuses.
Tech Stack
Categories
Data Engineering
About Agility Robotics
Agility Robotics builds and deploys Digit, a bipedal humanoid robot for logistics and manufacturing tasks such as tote handling and material flow in warehouses and distribution centers. The privately held company sells robots, software, and support services to industrial operators integrating automation alongside human workers. Founded in 2015 and headquartered in Salem, Oregon, it has commercially deployed systems in real-world facilities.