5 days ago
Remote, South AfricaMid Level / Senior
Responsibilities
- Translate stakeholder needs into scoped delivery plans and communicate designs, trade-offs, and progress to technical and non-technical audiences.
- Design, deliver, document, and maintain complex data pipelines and data models on Azure and Snowflake.
- Build ELT/ETL products for batch, micro-batch, and near-real-time data using tools such as Airbyte, Azure Event Grid, Azure Data Factory, and Kafka.
- Assemble datasets and maintain operational and analytical data systems that meet functional and non-functional requirements.
- Own pipeline reliability, monitoring, data quality, performance, and cost, and drive improvements when systems degrade.
- Apply test-driven development, code review, testing, code quality, and documentation standards.
- Collaborate with multidisciplinary data, analytics, machine learning, and business teams.
- Mentor junior and intermediate colleagues and contribute to hiring and onboarding.
- Demonstrate delivered work and create technical documentation and training materials.
Requirements
- A degree in computer science, engineering, information systems, mathematics, or a related quantitative field, or equivalent practical experience.
- 3-5 years of experience in data engineering.
- Strong hands-on Snowflake experience, including warehouse and resource management, semi-structured data handling, and performance and cost optimization.
- Experience with dbt models, tests, macros, snapshots, and documentation generation.
- Experience with schemachange, Flyway, Liquibase, or a similar database change-control tool.
- Proficiency in Jinja templating and advanced SQL, including DDL, DML, and JSON.
- Experience with incremental and batch loading methodologies, including CDC, CT, and CDC-style watermarking.
- Experience building ingestion pipelines from APIs, flat files, relational and NoSQL databases, and Azure Table Storage.
- Experience with Azure or another cloud platform such as AWS or GCP.
- Understanding of relational data structures, performance tuning, RDBMS and cloud data warehouses, relational and NoSQL databases, data modeling, data management, and governance.
- Proficiency in Python, Java, or Scala; Python is preferred.
- Practical experience applying generative AI and LLM tools such as Copilot, ChatGPT, or Claude to engineering or data workflows, including agentic development.
- Experience implementing CI/CD pipelines with GitLab, GitHub Actions, Azure DevOps, or similar technologies.
- Experience deploying data systems using infrastructure as code, preferably Terraform.
- Ability to produce high-quality technical documentation and communicate effectively with technical and non-technical stakeholders.
- Experience mentoring or technically guiding other engineers.
- Advantageous experience with Airflow, Airbyte, Kafka, Azure Event Grid, feature pipelines, or data products supporting machine learning and analytics workloads.
- An interest in the fintech space.
Tech Stack
AirbyteApache AirflowApache KafkaAWSAzuredbtFlywayGitHub ActionsGoogle Cloud PlatformJavaMicrosoft SQL ServerMongoDBPythonScalaSnowflakeSQLTerraform
Categories
Data Engineering
About Lula
Lula builds digital banking and lending products for South African small businesses, including a business bank account, cash‑flow tools, and unsecured funding. It monetizes through interest and fees on credit facilities and banking services delivered via web and mobile. Founded in 2014 and headquartered in Cape Town, the company rebranded from Lulalend and raised a Series B in 2023.