
Enterprise Data Architect – Customer Data Platform (Azure Databricks Lakehouse)
Southern Company2 days ago
Birmingham, AL, USAStaff+
Responsibilities
- Own the end-to-end architecture, standards, strategic direction, and roadmap for the Azure Databricks Lakehouse.
- Design batch and near-real-time CIS data replication, including Change Data Capture, streaming, and integration patterns.
- Guide data engineers on logical and physical data models supporting reporting, business intelligence, analytics, data products, and regulatory requirements.
- Establish standards for data quality, lineage, cataloging, observability, metadata management, access control, encryption, masking, and compliance.
- Govern integrations used by operational, analytical, and regulatory applications to consume customer, billing, metering, and premise data.
- Partner with cybersecurity, privacy, compliance, enterprise architecture, application, vendor, and business teams.
- Lead architecture reviews, mentor data engineering teams, and maintain reference architectures, decision records, and multi-year roadmaps.
- Define governed architecture patterns for machine learning, generative AI, and advanced analytics.
- Optimize Azure and Databricks capacity and cost and support major incident investigations and root-cause analysis.
- Evaluate emerging technologies and establish a working architecture-review practice during the first 12 months.
Requirements
- Bachelor’s degree in computer science, information systems, or a related discipline.
- At least 8 years of progressive experience in data architecture, data engineering, or analytics platform engineering, including at least 3 years in a senior architecture or technical leadership role.
- Experience leading the architecture of a production, enterprise-scale Azure Databricks Lakehouse with hands-on expertise in Delta Lake, Unity Catalog, and Azure Data Lake Storage Gen2.
- Experience designing and delivering CDC and replication from transactional systems into a lakehouse or warehouse for batch and near-real-time loads.
- Strong data modeling skills, including dimensional, Data Vault, or canonical models, plus experience governing data quality, metadata, lineage, and security controls.
- Experience establishing architecture standards, conducting architecture reviews, and driving engineering-practice adoption across multiple delivery teams.
- Strong communication and influencing skills with executives, engineers, vendors, and business stakeholders.
- Preferred experience with utility CIS platforms such as Oracle Customer to Meter, Oracle CC&B, SAP IS-U, or Cayenta.
- Preferred knowledge of utility billing, collections, meter-to-cash, revenue assurance, rates, regulatory reporting, NERC CIP, and state public utility commission requirements.
- Preferred experience with Apache Spark, Delta Live Tables, Structured Streaming, Databricks Workflows, Event Hubs, or Kafka.
- Preferred experience with Azure and Databricks resiliency, FinOps, and capacity planning.
- Agile, SAFe, product-oriented delivery, a master’s degree, or Azure, Databricks, or architecture certifications are preferred.
Benefits
- Hybrid schedule requiring three days on-site and two days remote per week.
- Approximately 25% travel is anticipated, with preference for candidates located within the electric service territory.
- The successful candidate remains an employee of the operating company while reporting to the CIS/MDM Program Team and may report to Southern Company Services or an operating-company leader for delivery.
Tech Stack
Categories
Data Engineering
About Southern Company
Southern Company is an investor-owned utility holding company headquartered in Atlanta and traded on the NYSE (SO). Through subsidiaries it provides electric service in Alabama, Georgia, and Mississippi and natural gas distribution in Georgia, Illinois, Tennessee, and Virginia, serving about 9 million customers. Its portfolio spans regulated utilities and competitive generation (Southern Power), with energy from natural gas, renewables, and nuclear (including Vogtle units in Georgia).