9 hours ago
Dallas, TX, USAMid Level
H1B sponsor
Responsibilities
- Administer Azure Databricks, Unity Catalog, workspace and metastore configuration, cluster policies, compute cost management, and chargeback reporting.
- Build self-service provisioning workflows, templates, access patterns, and platform automation for domain-owned data products.
- Serve as DBA for Lakebase and PostgreSQL, including provisioning, user and role management, performance tuning, upgrades, backups, point-in-time recovery, and disaster response.
- Build and maintain Azure Infrastructure-as-Code for networking, private endpoints, Entra ID app registrations, service principals, and Key Vault.
- Implement access governance including Unity Catalog grants, OBO authentication, ABAC, row-level security, data masking, and role-based access.
- Operate audit, lineage, sensitivity classification, observability, alerting, SLOs, backup validation, disaster recovery testing, and reliability controls.
- Support CI/CD for notebooks, jobs, DLT pipelines, dbt projects, Databricks Asset Bundles, and Lakebase schema migrations.
- Maintain GitHub and GitHub Actions integrations, advise domain teams during project kickoffs, troubleshoot platform issues, and produce KPI and roadmap reporting.
Requirements
- At least 4 years of platform or infrastructure engineering experience supporting a data or analytics organization.
- Deep hands-on experience with Databricks, Unity Catalog, Delta Lake, Azure, Entra ID, networking, Key Vault, and Terraform or Bicep.
- Hands-on PostgreSQL administration experience covering roles, connections, query and index tuning, backups, restore, point-in-time recovery, and HA/DR.
- Experience with identity and access architecture, including service principals and OBO authorization patterns.
- Practical experience building and maintaining CI/CD pipelines with GitHub Actions and/or Azure DevOps.
- Proficiency with Python or another scripting language for platform automation and tooling.
- Experience using AI tools such as GitHub Copilot, ChatGPT, or Claude to accelerate engineering work.
- Experience with infrastructure lifecycle management, disaster recovery, and regulated environments involving HIPAA and/or SOC 2.
- Strong candidates may have experience with data mesh, Databricks Lakebase or other cloud-native PostgreSQL services, psql, pgAdmin, migration frameworks, Azure SQL Database, OLTP-to-lakehouse integrations, Datadog, OpenTelemetry, Databricks Asset Bundles, DLT, dbt, and relevant certifications.
Benefits
- Medical, dental, and vision insurance.
- Short- and long-term disability insurance and life insurance.
- 401k with company match.
- Flexible time off and paid parental leave.
- Hybrid work in the Dallas, Texas office at least 3 days per week; no overnight on-call rotation, with occasional availability for scheduled deployments and major incidents.
Tech Stack
Categories
Data EngineeringDevOps
About Lantern
Lantern builds a specialty care platform that connects members of self-insured employers and labor funds with a nationwide Network of Excellence for surgery, cancer care, infusions, and other planned procedures. It sells bundled-case surgical and specialty benefits, pairing each member with care advocates and nurses to navigate treatment and reduce medical spend. The privately held company was founded in 2011 and is headquartered in Dallas, Texas.