over 4 years ago
Johannesburg, South AfricaSenior
Responsibilities
- Design and build scalable Microsoft Fabric and Databricks data platforms.
- Lead SQL modernization and migration from SQL Server to Fabric and Databricks.
- Build ETL/ELT pipelines using PySpark, Python, and SQL.
- Implement Delta Lake, Unity Catalog, and Purview governance.
- Design lakehouse and Bronze/Silver/Gold medallion architectures.
- Build semantic models and support Power BI reporting.
- Apply Kimball dimensional modeling best practices.
- Mentor junior engineers and contribute to technical best practices.
- Engage directly with enterprise clients and stakeholders while owning complex delivery outcomes.
Requirements
- 8+ years of experience in data engineering.
- 3+ years of hands-on Databricks delivery experience.
- Deep expertise in Microsoft Fabric and Databricks.
- Experience with data migration, modernization, consulting, or client-facing delivery.
- Proficiency with Spark/PySpark, SQL Server/T-SQL, Delta Lake/Delta Tables, lakehouse architecture, semantic modeling, Power BI, and Kimball dimensional modeling.
- Knowledge of Azure data services including Synapse, ADF, OneLake, and Purview.
- Knowledge of AWS data platforms including Glue, S3, and Redshift.
- Bachelor's degree in Computer Science, Engineering, or equivalent experience.
- Strong technical leadership, analytical problem-solving, stakeholder engagement, and mentoring skills.
Benefits
- Johannesburg-based role onsite in Sandton.
- Work on enterprise-scale data transformation projects.
- Collaborate with top-tier engineering talent.
- Receive mentorship, sponsored events, and ongoing professional development.
- Participate in continuous learning and technical communities.
- Join a people-first engineering culture.
Tech Stack
Categories
Data Engineering
About DVT
DVT is a South African technology services firm that builds custom software and supports AI, data engineering, testing, UX, and cloud projects. It provides consulting and staffed engineering teams for enterprises in South Africa and abroad, including work in banking and payments. Founded in 1999 and headquartered in Johannesburg, it is privately held and operates as a BEE Level 2 company.