Data Platform Engineer Principal_999
Allianz SE8 hours ago
Minneapolis, MN, USAStaff+
Base Salary
$130k - $170k/yr
Responsibilities
- Design Databricks architecture including Unity Catalog, Delta Lake optimization, cluster policies, compute pools, and job orchestration.
- Architect Azure data landing zones, networking, ADLS Gen2 designs, and Azure Data Factory/Synapse pipeline orchestration.
- Design Snowflake account architecture, ingestion, resource management, performance tuning, data sharing, and cost attribution.
- Define reference architectures, golden patterns, engineering standards, reusable IaC modules, and automation frameworks.
- Engineer fine-grained authorization, identity federation, secrets management, private connectivity, encryption, audit logging, and compliance evidence.
- Build cost observability, compute-efficiency controls, FinOps automation, chargeback/showback models, and spend anomaly detection.
- Define SLOs and SLIs, build observability capabilities, and design and test disaster-recovery architectures and runbooks.
- Build CI/CD and drift-detection pipelines for infrastructure and platform configuration.
- Lead Sev1/2 incident response, postmortems, and reliability improvements.
- Mentor junior and mid-level cloud administrators and data engineers and represent the data platform team in architecture governance.
Requirements
- 5+ years of experience in cloud infrastructure or platform engineering, including 3+ years focused on data platforms.
- Deep hands-on Databricks expertise, including Unity Catalog, Delta Lake internals, cluster and job architecture, and performance tuning at scale.
- Advanced Microsoft Azure experience with networking, IAM/Entra ID, ADLS Gen2, Azure Data Factory, and Synapse.
- Advanced Snowflake experience with warehouse and query optimization, RBAC, data sharing, and Snowpipe/Streams/Tasks.
- Strong Terraform expertise including module authoring, state management, and Databricks, Azure, and Snowflake provider configuration.
- Strong Python, PowerShell, and Bash scripting and automation experience.
- Understanding of distributed systems, Spark internals, query engines, and data lake/lakehouse architecture.
- Experience designing for regulated-environment compliance, including DORA, GDPR, data residency, and data lineage requirements.
- Proven incident-response and reliability-engineering experience, including SLO design, postmortems, and disaster-recovery testing.
- Preferred qualifications include Databricks Certified Data Engineer Professional, SnowPro Advanced Architect, or Azure Solutions Architect Expert certifications.
- Preferred experience includes financial services or insurance, DORA/GDPR implementation, OPA/Sentinel/Checkov, GitOps, Purview, Datadog, and internal developer platforms or self-service data infrastructure.
Benefits
- Hybrid work model balancing in-person collaboration and remote work.
- Health insurance, company bonus scheme, 401(k) with company match, paid holidays, paid time off, paid volunteer days, tuition reimbursement, paid parental leave, employee shares program, and employee discounts.
- Career development, digital learning programs, and international career mobility.
- Annualized base pay range of $130,000-$170,000, with potential eligibility for an incentive-based annual bonus.
Tech Stack
Categories
Data EngineeringDevOps
About Allianz SE
Allianz SE is a Munich-based public company that provides property-casualty, life and health insurance, and asset management to individuals and businesses worldwide. It earns premiums and investment-management fees, operating through brands such as Allianz Commercial and asset managers including PIMCO and Allianz Global Investors. Founded in 1890 and listed on the Frankfurt Stock Exchange, it serves over 100 million customers in about 70 countries.