2 months ago
Base Salary
$230k - $277k/yr
Responsibilities
- Scale self-healing data pipelines that handle schema evolution, detect anomalies, execute circuit breakers, and recover from failures automatically.
- Define and enforce enterprise data governance, access controls, data quality testing, schema evolution policies, and metadata management.
- Implement storage lifecycle strategies, resource throttling, and query optimization for high-throughput, low-latency data access.
- Optimize Databricks and AWS EMR environments for cost and performance.
- Build CI/CD deployment templates, environment isolation, version control standards, testing frameworks, rollback mechanisms, and automated deployment testing.
- Establish observability, alerting, data quality audits, compliance controls, and data retention practices.
Requirements
- 10+ years of hands-on experience in Data Platform Engineering or Software Engineering.
- Proven experience architecting and scaling production-grade data foundations.
- Deep expertise in scaling, optimization, query tuning, compute resource allocation, and compute-storage lifecycle policies.
- Experience implementing RBAC, Active Directory/IAM roles, fine-grained data masking, and enterprise compliance requirements such as SOX and audit trail controls.
- Track record establishing data governance frameworks, schema evolution controls, data quality audits, and near-real-time observability and alerting.
- Hands-on experience building automated deployment pipelines, environment isolation, rollback mechanisms, version control, and automated testing for data assets.
- Bonus: experience incorporating LLMs or GenAI into pipeline operations, using Terraform and EKS, optimizing GPU/CPU performance, or working in autonomous vehicles, robotics, or high-tech manufacturing.
About Zoox
Zoox builds a fully autonomous, purpose-built electric vehicle and the end-to-end platform to operate it as an urban robotaxi service. The company designs the vehicle, self-driving software, and fleet operations in-house to offer mobility-as-a-service rather than selling cars. Founded in 2014 and headquartered in Foster City, California, Zoox is a subsidiary of Amazon.