Staff Data Platform Engineer
Rivian and Volkswagen Group Technologies19 days ago
Base Salary
$154k - $212k/yr
Responsibilities
- Design, deploy, and maintain data platform infrastructure using Terraform and infrastructure-as-code principles.
- Manage and optimize the multi-region Databricks platform for security, performance, cost effectiveness, and global scale.
- Lead the technical design and architecture of scalable, reliable, and performant data systems.
- Collaborate with data producers, data consumers, business leaders, and cross-functional teams to gather requirements and provide technical guidance.
- Troubleshoot and resolve Databricks platform issues proactively.
- Stay current with big data, cloud computing, and DevOps advancements.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
- At least 3 years of hands-on experience in a similar role building and maintaining large-scale data processing systems.
- Strong knowledge of Databricks, including Delta, Spark, Unity Catalog, data governance, and workspace administration.
- Experience using Terraform to manage large-scale systems through infrastructure as code and maintaining CI/CD pipelines.
- Experience with cloud technologies such as AWS, GCP, or Azure.
- Strong analytical, problem-solving, communication, and cross-functional collaboration skills.
- Preferred: experience designing scalable data pipelines with PySpark and the Spark ecosystem, including Spark SQL and Spark Streaming.
- Preferred: familiarity with AWS IAM permissions, VPC networking, EC2 compute, and S3 storage.
Benefits
- Competitive base salary, annual company performance bonus eligibility, and equity in the form of RSUs; compensation amounts and equity are subject to applicable plans and conditions.
- Comprehensive benefits for full-time employees, including health coverage, retirement savings, time off, and family planning programs; offerings vary by country.
Tech Stack
Categories
Data EngineeringDevOps
About Rivian and Volkswagen Group Technologies
Rivian and Volkswagen Group Technologies is a 2024 joint venture building software and electrical architectures for software-defined electric vehicles. It develops in-vehicle operating systems, zonal controllers, connectivity, and cloud solutions used by Rivian and Volkswagen Group brands. The privately held company is headquartered in Palo Alto, CA, and focuses on creating a shared platform that can be integrated and licensed across multiple vehicle programs.