Red Ventures

Staff Data Engineer | Allconnect

Red Ventures
Apply
1 day ago
USA (city not specified)Staff+

Responsibilities

  • Drive architecture decisions with internal and external stakeholders.
  • Lead the development and modernization of Databricks environments across multiple teams.
  • Design and operate AI/ML data infrastructure, including feature stores and vector databases.
  • Build LLM-ready pipelines for embedding generation, retrieval, RAG data flows, and training-data versioning.
  • Partner with ML engineering teams to deliver governed, reliable, and cost-efficient model inputs.
  • Establish data governance, data quality, observability, access controls, and PII protections across pipelines.
  • Drive platform-level cost optimization, DevOps practices, CI/CD automation, and data contracts.
  • Mentor engineers and lead design reviews across teams.

Requirements

  • 10+ years of data engineering experience designing and operating large-scale data platforms.
  • Production experience with Databricks, SQL, Spark, and Python.
  • Infrastructure-as-code experience with Terraform for data platforms.
  • Experience with Airflow or Dagster, and with at least one streaming or messaging platform such as Kafka, Kinesis, or Rudderstack.
  • Experience with data governance frameworks or tools such as Unity Catalog, DataHub, Collibra, Atlan, RBAC, and PII controls.
  • Experience with data quality and observability tools such as Great Expectations, Soda, Monte Carlo, or OpenLineage.
  • Experience with DevOps and FinOps practices, GitHub Actions, data contracts, and platform-level cost optimization.
  • Ability to explain technical trade-offs to non-engineering stakeholders and guide design discussions with external partners.

Benefits

  • Health insurance with medical, dental, and vision coverage.
  • Life insurance, short- and long-term disability insurance, flexible spending accounts, holiday pay, and an employee assistance program.
  • 401(k) with match.
  • Paid parental bonding benefit program.
  • Flexible paid time off; full-time employees accrue 20 days annually, increasing to 25 days after five years.
  • The posting states that benefits are subject to eligibility requirements.

Tech Stack

Apache AirflowApache KafkaApache SparkDatabricksGitHub ActionsPythonSQLTerraform

Categories

Data Engineering
Red Ventures

About Red Ventures

1,001-5,000 employees

Red Ventures builds, acquires, and operates consumer digital brands and marketplaces across financial services, travel, home services, education, and health, monetized through performance marketing, affiliate commerce, and lead generation. Privately held and headquartered in Fort Mill, South Carolina, it was founded in 2000 and operates brands such as Bankrate, The Points Guy, and Lonely Planet, while also partnering with large enterprises on customer acquisition and digital growth.

Contact me