
Lead Data Engineer
AND Digital2 days ago
Birmingham, United KingdomStaff+
Responsibilities
- Develop and maintain production-grade data pipelines that support decision-making and data science applications.
- Deploy and maintain modern data platforms in a production-safe manner for large organizations.
- Apply data quality, data flow, organization, and data modelling practices.
- Use SQL and task orchestration tools to build reliable pipelines.
- Apply DataOps practices, including automated delivery, version control, and infrastructure as code.
- Create discoverable, addressable, trustworthy, and self-describing datasets for downstream consumers.
- Translate stakeholder needs into robust data product specifications.
- Use AI to augment delivery through coding, testing, and documentation while applying appropriate judgment.
- Collaborate with multidisciplinary teams and help connect technical engineering work to business value.
Requirements
- Practical experience using SQL and task orchestration software such as dbt, Airflow, Prefect, or Dagster to develop production-grade pipelines.
- Strong experience with Snowflake and/or Databricks; current certification is desirable.
- Hands-on experience with at least one cloud platform: AWS, Azure, or GCP.
- Experience with associated cloud technologies such as DynamoDB, Redshift, Kinesis Pipelines, Glue, Lambda, or QuickSight.
- Hands-on DataOps experience, including CI/CD, version control, and infrastructure as code.
- Experience with data quality, data modelling, data flow, and information organization.
- Experience adopting a Data Product mindset and creating trustworthy, discoverable datasets.
- Ability to translate stakeholder needs into robust data product specifications.
- Practical experience using AI-assisted coding, testing, or documentation.
- Strong communication, collaborative problem-solving, adaptability, and knowledge-sharing skills.
Benefits
- 25 days of bookable holiday plus flexible Bank Holidays.
- Employer pension contribution of 6% of salary, with a further 2% employee contribution that can be increased by choice.
- Aviva healthcare cover, including pre-existing condition cover.
- £1000 Flexibenefit allowance to select or upgrade benefits, with unused allowance available as cash.
- Life Assurance and Income Protection.
- Eye test and first pair of glasses.
- Enhanced maternity and partner/paternity leave.
- Inclusive, collaborative working environment organized into regional Clubs and Practice Areas.
Tech Stack
Categories
Data Engineering
About AND Digital
AND Digital is a London-headquartered consulting firm that builds and modernises web and mobile products, cloud platforms, and data capabilities for large consumer and enterprise brands. It embeds cross-functional teams with clients to deliver software while upskilling in-house teams through agile coaching and digital learning. Founded in 2014 and privately held, it operates across the UK and Netherlands; clients have included British Airways and Heineken.