3 days ago
Cairo, EgyptMid Level / Senior
Responsibilities
- Design, develop, and maintain end-to-end data pipelines across structured, semi-structured, and unstructured data sources.
- Implement ingestion, transformation, and orchestration frameworks using Azure Data Factory, Synapse, and/or Microsoft Fabric Data Pipelines.
- Develop and optimize ETL/ELT processes with Databricks, PySpark, SQL, and Delta Lake.
- Implement data quality, lineage, governance, security, privacy, and observability practices.
- Optimize performance and cloud costs while applying data engineering best practices.
- Collaborate with solution architects and participate in client workshops and technical discussions to translate business needs into technical designs.
Requirements
- 3–6 years of experience in data engineering.
- Hands-on experience with Azure Data Factory, Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Event Hub/IoT Hub, and Azure Functions.
- Hands-on experience with Databricks, PySpark, Spark SQL, Delta Lake, Unity Catalog, and Databricks Workflows.
- Proficiency in Python and SQL for large-scale data processing and transformation.
- Understanding of data modeling, medallion architecture, and lakehouse principles.
- Familiarity with CI/CD pipelines, DevOps, and version control such as Git and Azure DevOps.
- Knowledge of data governance, lineage, and observability tools.
- Experience with performance optimization, cost control, and cloud-environment best practices.
About PwC
PwC is a global network of professional services firms providing assurance, tax, and advisory work for businesses and public-sector clients. It sells project-based and managed consulting, audit, and deals services, and implements and integrates business applications. Formed in 1998 by the merger of Price Waterhouse and Coopers & Lybrand, it is headquartered in London and is one of the Big Four accounting firms.
