9 months ago
London, United KingdomStaff+
Responsibilities
- Design and build end-to-end data pipelines using AWS-native tools and modern data architectures.
- Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems.
- Apply AWS Well-Architected principles to create scalable, secure, and resilient platforms.
- Develop robust, tested, and fault-tolerant data engineering solutions.
- Build real-time event streaming pipelines and data lakehouse or data warehousing solutions.
- Support data governance requirements, including GDPR considerations.
- Mentor junior engineers and promote data engineering best practices across teams.
Requirements
- Proficiency in at least one of Python, Scala, or Java.
- Strong experience with big data technologies such as Spark and Hadoop.
- Practical experience building real-time event streaming pipelines using technologies such as Kafka, Spark Streaming, or Kinesis.
- Proficiency in AWS cloud environments.
- Experience developing modern data architectures, including data lakehouses and data warehouses.
- Understanding of CI/CD practices, DevOps tooling, and data governance, including GDPR.
- Expertise in data modelling, schema design, and structured and semi-structured data is advantageous.
- Familiarity with Hadoop, Spark, HDFS, Hive, Databricks, AWS Lake Formation, and ingestion or transformation automation is advantageous.
- Experience delivering solutions for highly regulated industries and mentoring engineering teams is advantageous.
Benefits
- Permanent role based in London with a hybrid work arrangement.
- Discretionary bonus, competitive pension, health insurance, life insurance, and critical illness cover.
- Mental health support through CareFirst, Unmind, Aviva consultations, and in-house first aiders.
- Maternity, adoption, shared parental, sickness, pregnancy loss, fertility treatment, menopause, and bereavement leave.
- Eight complimentary backup care sessions for emergency childcare or elder care.
- Five weeks of annual leave, with the option to buy or sell holiday days.
- At least 40 hours of training annually, including workshops, certifications, and e-learning.
- A business coach assigned from the first day.
- Online GP services, Gympass (Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work, and dental insurance.
Tech Stack
Categories
Data Engineering
About Capco
Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.