AND Digital

Lead Data Engineer

AND Digital
Apply
2 days ago
Birmingham, United KingdomStaff+

Responsibilities

  • Develop and maintain production-grade data pipelines that support decision-making and data science applications.
  • Deploy and maintain modern data platforms in a production-safe manner for large organizations.
  • Apply data quality, data flow, organization, and data modelling practices.
  • Use SQL and task orchestration tools to build reliable pipelines.
  • Apply DataOps practices, including automated delivery, version control, and infrastructure as code.
  • Create discoverable, addressable, trustworthy, and self-describing datasets for downstream consumers.
  • Translate stakeholder needs into robust data product specifications.
  • Use AI to augment delivery through coding, testing, and documentation while applying appropriate judgment.
  • Collaborate with multidisciplinary teams and help connect technical engineering work to business value.

Requirements

  • Practical experience using SQL and task orchestration software such as dbt, Airflow, Prefect, or Dagster to develop production-grade pipelines.
  • Strong experience with Snowflake and/or Databricks; current certification is desirable.
  • Hands-on experience with at least one cloud platform: AWS, Azure, or GCP.
  • Experience with associated cloud technologies such as DynamoDB, Redshift, Kinesis Pipelines, Glue, Lambda, or QuickSight.
  • Hands-on DataOps experience, including CI/CD, version control, and infrastructure as code.
  • Experience with data quality, data modelling, data flow, and information organization.
  • Experience adopting a Data Product mindset and creating trustworthy, discoverable datasets.
  • Ability to translate stakeholder needs into robust data product specifications.
  • Practical experience using AI-assisted coding, testing, or documentation.
  • Strong communication, collaborative problem-solving, adaptability, and knowledge-sharing skills.

Benefits

  • 25 days of bookable holiday plus flexible Bank Holidays.
  • Employer pension contribution of 6% of salary, with a further 2% employee contribution that can be increased by choice.
  • Aviva healthcare cover, including pre-existing condition cover.
  • £1000 Flexibenefit allowance to select or upgrade benefits, with unused allowance available as cash.
  • Life Assurance and Income Protection.
  • Eye test and first pair of glasses.
  • Enhanced maternity and partner/paternity leave.
  • Inclusive, collaborative working environment organized into regional Clubs and Practice Areas.

Tech Stack

Amazon DynamoDBAmazon RedshiftApache AirflowAWSAzureDatabricksdbtGoogle Cloud PlatformSnowflakeSQL

Categories

Data Engineering
AND Digital

About AND Digital

501-1,000 employees

AND Digital is a London-headquartered consulting firm that builds and modernises web and mobile products, cloud platforms, and data capabilities for large consumer and enterprise brands. It embeds cross-functional teams with clients to deliver software while upskilling in-house teams through agile coaching and digital learning. Founded in 2014 and privately held, it operates across the UK and Netherlands; clients have included British Airways and Heineken.

Contact me