Experian

Lead Data Platform Engineer

Experian
Apply
2 months ago
Nottingham, United KingdomStaff+

Responsibilities

  • Lead an outstanding Agile technical team and uphold high technical standards.
  • Build and maintain data pipelines and data lakes.
  • Deliver clean, scalable, reusable, and quality software.
  • Own the codebase and technical applications.
  • Collaborate with risk, security, and compliance teams on regulatory and industry requirements.
  • Identify overlapping technical requirements and help develop technology roadmaps.
  • Develop and integrate APIs and apply configuration-as-code principles.
  • Analyze, investigate, and compare large data sets when required.
  • Apply automated testing methodologies and support full application lifecycles.

Requirements

  • Strong experience with DevOps and infrastructure-as-code tooling, including Terraform, Git, Jenkins, and Harness.
  • Strong experience developing with Apache Spark and Hadoop.
  • Strong experience with AWS cloud services, including AWS Glue, S3, EventBridge, SQS, and Lake Formation.
  • Strong experience building data pipelines and data lakes.
  • Significant programming experience with Scala or Python.
  • Experience with Bitbucket, Jira, application lifecycle management, API integration, and configuration-as-code principles.
  • Experience writing scalable reusable code using SOLID principles, design patterns, and published coding standards.
  • Experience with automated testing methodologies.
  • Ability to collaborate with risk, security, and compliance teams regarding data privacy, security, GDPR, and PCI DSS requirements.

Benefits

  • Hybrid Nottingham-based working arrangement with 40% office attendance.
  • Great compensation package and discretionary bonus plan.
  • Pension, Bupa healthcare, Sharesave scheme, 25 days of annual leave, 8 bank holidays, and 3 volunteering days.
  • Option to purchase additional annual leave.
  • Inclusive, purpose-driven culture and support for disability or special-needs accommodations.

Tech Stack

Apache HadoopApache SparkAWSGitHarnessJenkinsPythonScalaTerraform

Categories

Data Engineering
Experian

About Experian

10,000+ employees

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, deliver digital marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them to save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agrifinance, insurance, and many more industry segments. We invest in talented people and new advanced technologies to unlock the power of data and innovate. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Contact me