Staff Data Engineer (Azure Databricks Platform)
CVS Health22 days ago
Base Salary
$130k - $261k/yr
Responsibilities
- Oversee platform operational health through monitoring, logging, alerting, incident response, and root cause analysis.
- Maintain and enhance the Azure Databricks architecture, including Delta Lake, Unity Catalog, and Databricks Workflows.
- Define the platform roadmap and drive adoption of new features, services, and best practices.
- Enforce data security and governance policies, including fine-grained access control, lineage, and regulatory compliance through Unity Catalog.
- Implement platform-level performance tuning and cost-management strategies for Databricks clusters and workloads.
- Automate provisioning, scaling, and management of Databricks workspaces and resources using Terraform and GitHub CI/CD pipelines.
- Create reusable patterns and libraries, provide technical support and training, and mentor data engineers and platform engineers.
- Partner with data engineering, business, security, networking, and infrastructure teams to maintain a cohesive platform.
- Oversee and direct the work of two platform engineers.
Requirements
- 8+ years of hands-on engineering experience focused on cloud data platforms, distributed systems, and data engineering.
- Deep hands-on experience administering and operating Azure Databricks, including cluster management, job orchestration, Delta Lake, and Unity Catalog.
- Expert knowledge of the Azure ecosystem, including Azure Data Lake Storage, Azure Active Directory, and networking components.
- Strong proficiency in Terraform, Python, Apache Spark/PySpark, SQL, and Shell scripting.
- Experience building Infrastructure as Code solutions and automated CI/CD pipelines for platform and data application deployments.
- Strong understanding of distributed computing and large-scale data-system architecture.
- Ability to diagnose and resolve complex platform-level issues and communicate effectively with technical and business stakeholders.
- Bachelor’s or master’s degree in Computer Science, Engineering, or a related field.
- Preferred experience with Azure Synapse, Kafka, Snowflake, healthcare data, or healthcare insurance feeds.
- Preferred certifications include Microsoft Certified: Azure Solutions Architect Expert, Databricks Certified Data Engineer Professional, and Databricks Certified Platform Administrator.
Benefits
- Full-time position with medical, dental, and vision coverage.
- Paid time off, retirement savings options, wellness programs, and other eligible resources.
- Eligible for CVS Health bonus, commission, or short-term incentive programs and an equity award program; compensation figures excluded.
- Application window is anticipated to close on 11/13/2026.
Tech Stack
Categories
Data EngineeringDevOps
About CVS Health
CVS Health is a U.S. health care company that operates thousands of retail pharmacies, runs the CVS Caremark pharmacy benefits manager, and owns the Aetna health insurance business. It sells prescriptions, retail health goods, and insurance plans, and provides primary and urgent care through MinuteClinic and other services for consumers, employers, and government programs. Founded in 1963 and headquartered in Woonsocket, Rhode Island, it is a public company traded on the NYSE.