Senior Data Engineer

2 days ago

London, United KingdomSenior

Responsibilities

Design and build dependable, scalable data pipelines from ingestion through consumption.
Own production deployments of containerized data applications and ETL infrastructure on Kubernetes and EKS across AWS and GCP.
Build and maintain batch and streaming workflows using Python, SQL, dbt, Kafka, Flink, Airflow, CDC, user event tracking streams, and REST APIs.
Improve data quality and reliability through testing frameworks, monitoring, anomaly detection, SLOs, and runbooks.
Build platform capabilities such as config-driven table onboarding to enable self-service data onboarding.
Support analytics engineers and machine learning engineers with performant data sources and reliable platform foundations.
Collaborate with the Data Platform team to establish and uphold engineering practices.
Partner with legal and security teams on governance, compliance, security policies, HIPAA/PHI handling, UK GDPR, and cross-border patient data access.
Help shape Terraform-based infrastructure as code, CI/CD, versioning, and deployment practices for the data platform.
Participate in code review, mentoring, and cross-functional communication of technical trade-offs.

Typically 5+ years of data engineering experience designing and maintaining end-to-end pipelines.
Hands-on experience with Python, SQL, dbt, Kafka, Flink, Airflow, and REST APIs.
Experience running containerized infrastructure on Kubernetes and working with Terraform, CI/CD, and code versioning practices.
Experience with AWS and GCP is preferred, ideally across both environments.
Experience implementing testing frameworks, observability tooling, SLOs, and runbooks for data workloads.
Track record of building platform tooling that enables analysts, analytics engineers, and business colleagues to work with data independently.
Ability to collaborate with analytics engineers, machine learning engineers, DevOps, legal, security, and non-technical colleagues.
Experience taking ownership of systems, contributing through code review and mentoring, and exercising judgment in ambiguous environments.
Experience in regulated sectors such as healthtech, fintech, or gaming is desirable.
Familiarity with reverse-ETL or data activation tools such as Hightouch or Segment is desirable.

Employee options programme.
Annual development budget and 3 days of professional development leave.
Hybrid setup with 3 days per week in the Old Street office.
Private health insurance through Vitality or a monthly wellness allowance.
25 days of holiday, enhanced parental leave, and the ability to work from anywhere for 3 weeks per year.
Regular socials, clubs, after-school sport, and seasonal events.

501-1,000 employees