Associate Data Platform Engineer
Impact.com16 hours ago
Cape Town, South AfricaEntry Level / Mid Level
Responsibilities
- Build and extend batch and streaming pipeline components in Scala and Python under guidance.
- Develop Spark transformations, Airflow DAGs, and Kafka consumers with senior support.
- Configure BigQuery tables, partitioning strategies, and Cloud Storage buckets.
- Build monitoring dashboards, alerting, and data quality checks for pipeline health, latency, anomalies, schema violations, and missing data.
- Shadow on-call rotations, investigate incidents, debug with logs, metrics, and traces, and maintain runbooks and operational documentation.
- Follow least-privilege access, secrets management, and PII-handling practices while considering cost and performance.
- Participate in code reviews, pairing, technical discussions, and collaborative development.
Requirements
- 1–3 years of experience in software engineering, data engineering, or a related technical role.
- Working programming ability in Scala, Java, or Python, with willingness to develop strength in Scala and Python.
- Solid SQL fundamentals, including joins, aggregations, window functions, and query behavior.
- Understanding of data structures, algorithms, software engineering basics, Git, and collaborative development workflows.
- Exposure to or eagerness to learn Spark, Kafka or Pub/Sub, Airflow, and a major cloud platform, ideally GCP with BigQuery, Dataproc, and Cloud Storage.
- Strong problem-solving instincts and a methodical approach to debugging.
- Clear written and verbal communication and willingness to participate in on-call learning and operational work.
- Internship, academic, or personal data pipeline project experience is advantageous.
- Exposure to CI/CD, automated testing, infrastructure as code, Parquet, Avro, JSON, dbt, Looker, or BI tooling is advantageous.
- A bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field and digital marketing technology industry experience are advantageous.
Benefits
- Responsible PTO policy and a flexible work environment.
- Up to 12 fully covered therapy or coaching sessions per year, with additional dependent coverage, plus monthly gym reimbursement.
- Restricted Stock Units with a three-year vesting schedule, pending Board approval.
- Free Coursera subscription and PXA courses.
- Twenty-six weeks of fully paid parental leave for the primary caregiver and 13 weeks for the secondary caregiver.
- Technology stipend for a home office and monthly internet allowance.
- Cape Town hybrid work arrangement with two days per week in the office.
Tech Stack
Apache AirflowApache KafkaApache SparkdbtGitGoogle BigQueryGoogle CloudGoogle Cloud PlatformJavaPythonScalaSQL
Categories
Data Engineering
About Impact.com
Impact.com builds a SaaS platform for partnership and affiliate marketing, used by brands to manage affiliates, influencers, content publishers, and referrals, with tools for tracking, attribution, commissioning, and fraud detection. Its revenue comes from software subscriptions and related services. Founded in 2008 and headquartered in Santa Barbara, California, it is privately held and counts customers such as Walmart, Uber, Shopify, Lenovo, L’Oréal, and Fanatics.