Senior Microsoft Fabric Data Engineer - Manager - Data & AI - Technology Consulting - Advisory
PwC1 month ago
Dublin, IrelandStaff+
Responsibilities
- Design, develop, deploy, and support enterprise-scale Microsoft Fabric solutions.
- Design and maintain scalable Lakehouse, Warehouse, and Medallion Architecture patterns.
- Build ingestion frameworks using Fabric Data Factory, Dataflows Gen2, Fabric Mirroring, shortcuts, APIs, databases, SaaS applications, and cloud-native data sources.
- Develop Spark, PySpark, and SQL transformation pipelines and scalable ETL/ELT frameworks.
- Integrate structured, semi-structured, and streaming data into Microsoft Fabric OneLake.
- Design real-time analytics solutions using Eventstreams and Real-Time Intelligence.
- Enable AI-ready data foundations for Copilot, Fabric Data Agents, Machine Learning, and Generative AI workloads.
- Implement data quality controls, validation, monitoring, automated alerting, governance, metadata management, lineage, and security controls.
- Establish CI/CD pipelines, source control standards, testing frameworks, and automated deployment processes using Azure DevOps and Git.
- Develop reusable templates, accelerators, and engineering frameworks.
- Monitor performance, optimize workloads, and troubleshoot complex data engineering issues.
- Collaborate with architects, stakeholders, analysts, and AI teams to deliver governed, secure, compliant, and high-performing data platforms.
- Own end-to-end delivery of data engineering workstreams.
Requirements
- 6+ years of experience in data engineering and Azure Analytics platforms.
- Hands-on experience delivering modern Azure Data & Analytics solutions and Microsoft Fabric implementations in production.
- Strong experience with Fabric Lakehouse, Fabric Warehouse, OneLake, Data Factory, Dataflows Gen2, Notebooks, and Semantic Models.
- Extensive experience building scalable ETL/ELT solutions and modern data platforms.
- Strong expertise in SQL, Python, PySpark, and data modeling principles.
- Experience with Medallion Architecture, Delta Lake, APIs, SaaS platforms, databases, and cloud-based systems.
- Strong understanding of data governance, security, metadata management, and compliance practices.
- Experience implementing CI/CD pipelines, source control, and DevOps engineering practices.
- Ability to troubleshoot, optimize, and support enterprise-scale data platforms.
- Strong communication and stakeholder management skills across technical and business teams.
- Experience collaborating with Solution Architects, Data Analysts, and engineering teams on complex data platform solutions.
Benefits
- Continuous learning and leadership development opportunities.
- Access to cutting-edge technology and PwC perks, including exclusive discounts, experiences, and extras.
- Inclusive culture with confidential support and reasonable adjustments available during recruitment.
Tech Stack
Categories
Data Engineering
About PwC
PwC is a global network of professional services firms providing assurance, tax, and advisory work for businesses and public-sector clients. It sells project-based and managed consulting, audit, and deals services, and implements and integrates business applications. Formed in 1998 by the merger of Price Waterhouse and Coopers & Lybrand, it is headquartered in London and is one of the Big Four accounting firms.