3 months ago
Palo Alto, CA, USAMid Level
H1B sponsor
Responsibilities
- Build and maintain aircraft telemetry ingestion and transformation pipelines from S3 into the flight data warehouse using AWS Glue and Athena.
- Design and maintain curated SQL marts for flight runs, component flight hours, vehicle modes, and battery flight features.
- Develop and operate Python services that evaluate flight health checks and deliver alerts through SNS and Slack.
- Own automated data quality gates covering mart freshness, source-to-mart reconciliation, and watermark integrity.
- Build fleet monitoring dashboards and query interfaces and convert recurring analyses into supported datasets.
- Collaborate with firmware, GNC, battery, systems engineering, flight operations, and MRO teams to define logging, alerts, and signal quality.
Requirements
- Bachelor’s degree in Computer Science, Computer or Electrical Engineering, or a related technical discipline.
- At least 3 years of professional data engineering experience building and operating production pipelines.
- Strong SQL skills, including window functions and query tuning on distributed columnar engines such as Athena, Trino, Presto, Spark, Snowflake, or BigQuery.
- Proficiency in Python for production services, including packaging, dependency management, unit testing, and code review.
- Hands-on experience with S3, Glue, Athena, Lambda, SNS, CloudWatch, and IAM.
- Experience with dimensional modeling and warehouse design, including partitioning strategies for large tables.
- Strong analytical and written communication skills and the ability to work across multidisciplinary teams.
- Preferred qualifications include 5+ years of relevant data engineering experience, operational or on-call ownership, Terraform, GitLab CI or equivalent, dbt, data quality and testing frameworks, telemetry, observability, and alert design.
- Familiarity with aerospace, automotive, or robotics telemetry; embedded logging formats; FAA certification or continued airworthiness processes; or aviation is preferred.
Benefits
- Comprehensive medical, dental, vision, and 401k benefits.
- Contract position requiring onsite work at the headquarters in Palo Alto, California.
- Applicants must be eligible for employment in the United States.
Tech Stack
Categories
Data Engineering
About Pivotal
Pivotal is a philanthropic and programmatic organization founded by Melinda French Gates that supports programs, investments, and policy to expand women’s and young people’s power and opportunities in the U.S. and worldwide. It operates through Pivotal Philanthropies, Pivotal Initiatives Fund, and Pivotal Ventures, using grants and strategic partnerships rather than selling products. The organization is privately held and headquartered in Seattle.