3 months ago
Cape Town, South AfricaStaff+
Responsibilities
- Define and maintain data engineering architecture for Data Science, Machine Learning, Generative AI, and agentic AI workloads.
- Design AWS-to-Azure data integration patterns and coordinate with IT, Data Platform, Cloud, Security, and Governance teams.
- Build reusable pipelines, transformations, curated datasets, and standardized ingestion, orchestration, and publishing frameworks.
- Establish feature-store capabilities, data lineage, versioning, monitoring, model deployment, retraining, and production-grade MLOps and LLMOps practices.
- Provide data engineering foundations for Generative AI and agentic AI solutions, including enterprise information ingestion, chunking, indexing, and governance.
- Lead technical delivery and coordinate Data Engineers supporting the Data Science portfolio.
- Establish monitoring, operational support, incident management, and cloud cost-optimization practices.
- Act as the primary technical liaison with architecture, infrastructure, cybersecurity, and governance teams.
Requirements
- 7+ years of senior-level experience in data engineering, architecture, and cloud platforms.
- Degree in Computer Science, Information Systems, Data Engineering, Software Engineering, Mathematics, or a related field.
- Strong practical experience with Microsoft Azure data and AI services and integrating data across AWS and Azure environments.
- Experience building and operating production batch, incremental, streaming, or API-based data pipelines with orchestration, automated testing, monitoring, and deployment practices.
- Experience supporting Data Science, machine learning, or AI teams, including MLOps or model deployment capabilities.
- Strong Python and SQL skills, with experience in data modelling and transformation frameworks.
- Experience with Git-based source control, CI/CD pipelines, and Infrastructure as Code.
- Experience working with data governance, information security, and enterprise architecture teams, and leading technical delivery or coordinating engineers.
- Microsoft Azure and/or AWS architecture or engineering certifications are advantageous.
- Experience with Microsoft Fabric, Synapse Analytics, Databricks, AWS services, feature stores, model registries, experiment-tracking platforms, containerisation, orchestration technologies, and relational, document, vector, or analytical databases is advantageous.
- Exposure to FinOps and cloud cost-optimization practices is advantageous.
About DVT
DVT is a South African technology services firm that builds custom software and supports AI, data engineering, testing, UX, and cloud projects. It provides consulting and staffed engineering teams for enterprises in South Africa and abroad, including work in banking and payments. Founded in 1999 and headquartered in Johannesburg, it is privately held and operates as a BEE Level 2 company.