Data Engineer, Principal
Blue Shield of California1 month ago
Oakland, CA, USAStaff+
Responsibilities
- Lead the design, development, and implementation of scalable data pipelines for enterprise data lakes, warehouses, and marts.
- Engineer ELT/ETL solutions for structured and semi-structured data from internal and external sources.
- Apply Data Vault 2.0, dimensional, and domain-oriented data modeling techniques.
- Build and optimize cloud data solutions using Snowflake, Databricks, and Synapse for performance, scalability, reliability, and cost efficiency.
- Implement data quality, validation, observability, lineage, privacy, security, and governance controls in data pipelines.
- Apply DevOps and DataOps practices including CI/CD, automated testing, infrastructure as code, monitoring, and alerting.
- Provide hands-on technical leadership and mentorship to senior and mid-level data engineers.
- Partner with architecture, solution design, product, portfolio, analytics, and data engineering teams on enterprise technical solutions.
- Identify performance bottlenecks, reliability risks, and optimization opportunities across data platforms and workflows.
- Support integration of AI/ML-ready data assets for advanced analytics and enterprise data products.
- Advocate for modern data engineering patterns and practices aligned with enterprise strategy.
Requirements
- Bachelor's degree or equivalent experience.
- At least 10 years of relevant data engineering experience.
- Experience supporting enterprise AI/ML, advanced analytics, and data product ecosystems.
- Expertise in Data Vault 2.0, dimensional modeling, lakehouse architecture, or domain-driven data design.
- Demonstrated ability to influence enterprise architecture decisions and mentor senior engineering talent.
- Expert knowledge of data management, data modeling, master data management, data integration, data architecture, data virtualization, data warehousing, and data privacy and security.
- Understanding of AI/ML concepts and hands-on experience applying AI-driven solutions in enterprise environments.
- Hands-on experience with SQL, Python, DBT Cloud, and DBT Core.
- Expertise in one or more NoSQL and database platforms or appliances, including Snowflake, Synapse, and Databricks.
- Experience designing and scaling large-volume, high-performance data platforms using parallel and distributed architectures.
- Advanced knowledge of CI/CD, source control, and agile delivery tooling such as Git, Bitbucket, and Jira.
- Experience in healthcare, regulated environments, or large enterprises is strongly preferred.
About Blue Shield of California
Blue Shield of California is a nonprofit, tax-paying health plan that sells medical, dental, and vision insurance to individuals, employers, and Medicare/Medi-Cal beneficiaries across California. An independent member of the Blue Shield Association, it also administers government program plans. Founded in 1939 and headquartered in Oakland, the company serves nearly 6 million members statewide.