8 months ago
London, United KingdomSenior
Responsibilities
- Design and build end-to-end data pipelines using AWS-native tools and modern data architectures.
- Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems.
- Apply AWS Well-Architected Principles to create scalable, secure, and resilient platforms.
- Develop robust, tested, and fault-tolerant data engineering solutions.
- Build real-time event streaming pipelines and modern data lakehouse and warehousing solutions.
- Support and mentor junior engineers and contribute to team knowledge sharing and data engineering best practices.
Requirements
- Proficiency in at least one of Python, Scala, or Java.
- Strong experience with big data technologies such as Spark and Hadoop.
- Practical experience building real-time event streaming pipelines using technologies such as Kafka, Spark Streaming, or Kinesis.
- Proficiency in AWS cloud environments.
- Proven experience developing modern data architectures, including data lakehouses and data warehouses.
- Understanding of CI/CD practices, DevOps tooling, and data governance including GDPR.
- Expertise in data modeling, schema design, and handling structured and semi-structured data is advantageous.
- Familiarity with distributed systems including Hadoop, Spark, HDFS, Hive, and Databricks is advantageous.
- Exposure to AWS Lake Formation and automation of ingestion and transformation layers is advantageous.
- Experience delivering solutions for highly regulated industries and mentoring data engineering teams is advantageous.
Benefits
- Permanent London role with a hybrid work arrangement.
- Discretionary bonus, competitive pension, health insurance, life insurance, and critical illness cover.
- Mental health support through CareFirst, Unmind, Aviva consultations, and in-house first aiders.
- Family-friendly leave policies and paid leave for sickness, pregnancy loss, fertility treatment, menopause, and bereavement.
- Eight complimentary backup care sessions for emergency childcare or elder care.
- Five weeks of annual leave with the option to buy or sell holiday days.
- At least 40 hours of training annually, access to certifications and e-learning, and a business coach from day one.
- Online GP services, dental insurance, travel insurance, Gympass (Wellhub), Tastecard, season ticket loans, and Cycle to Work.
Tech Stack
Categories
Data Engineering
About Capco
Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.