1 month ago
Cape Town, South AfricaSenior
Responsibilities
- Design, develop, and implement scalable ETL/ELT pipelines using Matillion and GCP services.
- Ingest, transform, and load digital, media, customer, and product data into Snowflake.
- Configure and manage data streams from RudderStack, APIs, analytics tools, and other raw data feeds.
- Develop SQL transformations, analytical data models, and schemas for reporting and product analytics.
- Monitor, maintain, and optimize the performance, security, and cost efficiency of GCP and Snowflake infrastructure.
- Implement data quality checks, validation rules, automated monitoring, and pipeline troubleshooting.
- Support reporting and visualization consumers using Tableau, Amplitude, and related analytics platforms.
- Create documentation for pipelines, data models, schemas, and data dictionaries.
- Follow data governance, privacy, and security practices including GDPR and CCPA requirements.
- Collaborate with analysts, data scientists, product managers, solution architects, client teams, and other stakeholders.
- Automate data management, monitoring, deployment, and API integration tasks using Python and other scripting.
- Engage directly with clients to gather requirements, present solutions, and manage expectations.
Requirements
- Minimum 5 years of engineering and development experience.
- Strong client-facing, consulting, organization, problem-solving, and communication skills.
- Experience with enterprise-level clients, complex web and mobile ecosystems, privacy regulations, and data governance.
- Proven experience with Google Cloud Platform, including BigQuery, Cloud Storage, Cloud Functions, and Cloud Composer or Apache Airflow.
- Strong Snowflake experience covering data loading, SQL querying, performance tuning, and schema design.
- Hands-on experience designing and building pipelines with Matillion or similar tools such as Fivetran or Stitch.
- Experience with RudderStack for event collection, data routing, and destination management.
- Experience integrating data with Amplitude or similar product analytics platforms such as Mixpanel or Pendo.
- Advanced SQL proficiency and experience using Python for scripting, automation, and API integrations.
- Experience supporting BI consumers with Tableau or alternatives such as Looker Studio and Power BI.
- Experience integrating APIs, including REST and GraphQL, SFTP, and event-driven data architectures.
- Practical experience with analytical data modeling and proficiency with Git.
- Understanding of digital marketing, media reporting, product usage, customer journey data, analytics ecosystems, and machine learning data support.
- Experience engaging as a senior consultant and working within a project management office framework.
- Preferred experience with AWS, Azure, Docker, Kubernetes, and Kafka.
Benefits
- Hybrid work arrangement with teams in the office an average of four days per week.
- UK working hours are required.
- Equal opportunity workplace with accommodations or flexibility available for discussion during the interview process.
Tech Stack
Apache AirflowApache KafkaAWSAzureDockerGitGoogle BigQueryGoogle Cloud PlatformGraphQLKubernetesLooker StudioPythonSnowflakeSQL
Categories
Data Engineering
About VML
VML is a global marketing and advertising agency that designs brand experiences, customer journeys, and commerce programs for large consumer and enterprise brands. It operates in 55+ markets with principal offices including New York, London, and Singapore, and is part of WPP. Notable clients include Ford, Microsoft, Coca‑Cola, and Nestlé, spanning health, retail, and technology sectors.
