Data Engineer (we have office locations in Cambridge, Leeds and London)
Genomics England12 days ago
London, United KingdomSenior
Responsibilities
- Design, build and optimise scalable data pipelines and processing systems from acquisition and transformation through delivery.
- Work with large clinical and genomic datasets, including data lineage, metadata capture, de-identification and reference-data integration.
- Build and improve AWS data solutions using storage, compute and orchestration technologies.
- Develop and optimise data models, storage solutions and data products for performance, scalability, security, cost and reliable delivery.
- Improve data quality, testing, automation and observability so pipelines and services remain reliable and maintainable.
- Collaborate with engineering, QA, architecture, product and specialist teams to deliver integrated data services.
- Enable machine learning and data visualisation through trusted, well-structured data.
- Share knowledge and strengthen data engineering practices across the organisation.
Requirements
- Proven hands-on experience designing, building and optimising data pipelines and large-scale processing systems, including ETL and ELT.
- Strong practical AWS and cloud-based data engineering experience, including storage, compute and orchestration technologies.
- Strong Python coding skills and experience with testing, CI/CD and infrastructure as code.
- Experience developing data models and reliable data products, with knowledge of data engineering patterns and practices.
- Understanding of data quality, lineage, metadata management and data governance.
- Experience handling sensitive data in regulated environments, including security, performance, scalability and compliance considerations.
- Experience with genomic, bioinformatics, clinical or other complex healthcare datasets.
- Familiarity with data orchestration, visualisation, data management and secure data transfer tools.
- Ability to collaborate across technical and non-technical teams and communicate complex concepts clearly.
- Knowledge of healthcare data models, standards and terminology such as FHIR, HL7, OMOP or SNOMED CT is desirable.
- Familiarity with NHS and wider healthcare data ecosystems, healthcare data linkage, pseudonymisation, information governance or Trusted Research Environments is desirable.
- Experience enabling secondary use of health data for research, analytics or scientific use cases is desirable.
- Experience supporting machine learning or data visualisation through reliable data pipelines and products is desirable.
- Ideally, a master’s degree or equivalent practical experience in data engineering, data science, biostatistics, informatics or a related field.
Benefits
- 30 days’ holiday plus bank holidays and additional long-service leave.
- Option to apply for up to 30 days of remote working abroad annually, subject to approval.
- Blended working with most employees expected in the office at least twice each month; office locations include Canary Wharf, Cambridge and Leeds.
- Flexible working, enhanced maternity, paternity and shared parental leave benefits.
- Defined contribution pension with employer double-matching up to 10%, life assurance at three times salary, an electric vehicle salary sacrifice scheme and a Give As You Earn scheme.
- Individual learning budgets, training and certification support, and reimbursement for one annual professional subscription, subject to approval.
- Employee recognition programme and referral scheme.
- Subsidised gym membership, free Headspace account, Employee Assistance Programme, eye tests and flu jabs.
- Successful candidates are subject to a Standard Disclosure and Barring Service check.