2 days ago
Nottingham, United KingdomSenior
Responsibilities
- Design, build, test, and maintain AWS-based data pipelines for fraud-related data assets.
- Develop ingestion, transformation, data flows, integrations, and automation for data from Snowflake and internal systems.
- Apply Infrastructure as Code, Configuration as Code, automation, and cloud-native tooling to deliver repeatable solutions.
- Collaborate with platform, security, compliance, data, and delivery stakeholders on secure, governed, and supportable implementations.
- Contribute to technical designs, proposal reviews, option evaluations, estimates, roadmaps, and practical solution recommendations.
- Document pipelines, data flows, operational procedures, and support processes.
- Support junior engineers and contribute to a collaborative, quality-focused engineering culture.
Requirements
- Strong experience building data pipelines, data lake solutions, or data platform capabilities.
- Strong AWS cloud experience relevant to data engineering and platform delivery, including AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge, and SQS.
- Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, Git, Jenkins, and CI/CD pipelines.
- Strong Apache Spark or Hadoop development experience.
- Significant programming experience with Scala or Python.
- Strong understanding of cloud security, data privacy, access control, and governance principles.
- AWS Developer Certification or another relevant AWS certification is desirable.
- Strong Terraform or CloudFormation expertise is desirable.
- Experience with OpenShift or Kubernetes is desirable.
- Experience with automated testing tools such as pytest or Scalatest is desirable.
- Knowledge of RESTful APIs and microservice architectures is desirable.
- Experience with sensitive, governed, or regulated data environments is desirable.
- Familiarity with data catalogues, metadata management, data marketplaces, or federated data mesh concepts is desirable.
Benefits
- Great compensation package and discretionary bonus plan.
- Pension, Bupa healthcare, sharesave scheme, and other core benefits.
- 25 days of annual leave, 8 bank holidays, and 3 volunteering days.
- Option to purchase additional annual leave.
- Hybrid Nottingham-based work arrangement with 40% of time in the office.
Tech Stack
Categories
Data Engineering
About Experian
Experian builds credit reporting, identity and fraud prevention, and data analytics software that help lenders, insurers, healthcare providers, and marketers make decisions; it also offers consumer credit monitoring and scores. The company earns via data licensing, decisioning software, and subscription services, operates in 30+ countries, is headquartered in Costa Mesa, California, and is a FTSE 100 public company listed on the London Stock Exchange (EXPN); it is one of the three major U.S. credit bureaus.