2 days ago
Base Salary
$111k - $139k/yr
Responsibilities
- Build and scale Databricks environments as code across multiple AWS accounts using Terraform, Unity Catalog, cluster policies, and AWS networking and identity services.
- Build platform observability, including monitoring, alerting, lineage, data quality, and dashboards for reliability, performance, and cost.
- Create self-service access, environment provisioning, workspace lifecycle, onboarding, and access-audit automation for engineers and analysts.
- Automate Databricks and cloud configuration using Databricks Asset Bundles, CI/CD, GitOps workflows, and multi-tier deployments.
- Develop Go and Python libraries, CLI tools, APIs, abstractions, and templates for secure, tested, cost-aware platform usage.
- Own component reliability and security, meet SLOs, respond to incidents, investigate root causes, and prevent recurrence.
- Monitor and optimize Databricks costs, DBU consumption, cluster sizing, Spark and Delta workloads, and chargeback data.
- Implement Unity Catalog governance and security, including row- and column-level security, ABAC, lineage, identity-provider synchronization, and secret rotation.
- Evaluate open data formats and distributed compute options, including Delta Lake and Apache Iceberg interoperability.
- Use AI models and agents to improve productivity and help the business use data.
Requirements
- At least 8 years of experience in software engineering, data infrastructure, platform engineering, or SRE.
- At least 3 years managing production Databricks environments through Terraform, APIs, and SDKs, with deep knowledge of Unity Catalog, System Tables, compute policies, and Asset Bundles.
- Expertise in Apache Spark internals and tuning, including batch, microbatch, and streaming tradeoffs at multi-petabyte scale.
- Strong AWS experience with IAM, S3, KMS, VPC peering, subnets, security groups, and cost management.
- Experience with Terraform, Databricks Asset Bundles, CI/CD, GitOps, Docker, Kubernetes, and zero-downtime infrastructure updates across development, staging, and production environments.
- Experience with observability and governance practices including metrics, logs, alerting, SLOs, RBAC, ABAC, lineage, auditing, encryption, and secret management.
- Experience with open table formats and distributed data systems such as Delta Lake, Apache Iceberg, Kafka, and columnar stores.
- Experience building internal developer tools, APIs, or CLIs and applying agile methods to improve transparency and prioritization.
- Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, Artificial Intelligence, or a related field, or equivalent experience; a higher degree is a plus.
- Experience with data transformation.
Benefits
- Atlanta, Georgia location with full-time employment.
- Comprehensive benefits for eligible full-time and part-time employees, spouses or domestic partners, and children up to age 26.
- Paid vacation, paid sick leave, and life, medical, dental, vision, short-term disability, and long-term disability insurance for eligible employees.
- Potential eligibility for Rivian’s 401(k) Plan and Employee Stock Purchase Program.
- Full-time employee benefits coverage begins on the first day of employment; part-time coverage begins the first of the month after 90 days.
- Potential eligibility for annual performance bonuses and equity awards.
- Applications are expected to remain open no sooner than November 30, 2026.
Tech Stack
Categories
Data EngineeringDevOps
About Rivian
Rivian designs and manufactures electric vehicles, including the R1T pickup, R1S SUV, and commercial delivery vans, selling directly to consumers and fleet operators. Founded in 2009 and headquartered in Irvine, California, it operates a manufacturing plant in Normal, Illinois, and is publicly traded on NASDAQ. The company also develops in-vehicle software and electrical architecture and offers charging and service support for its owners.
