8 months ago
London, United KingdomStaff+
Responsibilities
- Lead the end-to-end delivery of Databricks-based solutions across Azure environments.
- Architect secure and scalable streaming and batch data pipelines using Delta Lake, Spark Structured Streaming, and Unity Catalog.
- Develop and enforce engineering best practices across the data lifecycle.
- Engage with clients to define solution strategies and data-governance frameworks.
- Mentor engineering teams and contribute to internal capability development initiatives.
- Support pre-sales and RFP engagements through client-facing and commercial expertise.
- Contribute to Capco thought leadership and internal initiatives.
Requirements
- Proven experience with Databricks, including Unity Catalog, Delta Lake, and orchestration.
- Expertise in Python, PySpark, and distributed data-processing frameworks.
- Extensive experience developing CI/CD pipelines with Azure DevOps, Jenkins, or GitHub Actions.
- In-depth understanding of data lakehouse principles, data modelling, and GDPR-compliant design.
- Experience building production-grade data pipelines from ingestion through serving.
- Strong client-facing and commercial skills are advantageous for pre-sales and RFP work.
- Experience coaching and mentoring engineering teams is advantageous.
- Scala or Java development experience is a bonus.
- Exposure to PII handling and regulatory frameworks such as GDPR is a bonus.
Benefits
- Permanent position based in London with a hybrid work arrangement.
- Discretionary bonus, competitive pension, health insurance, life insurance, and critical illness cover.
- Mental-health support through CareFirst, Unmind, Aviva consultations, and in-house first aiders.
- Maternity, adoption, shared parental, sickness, pregnancy-loss, fertility-treatment, menopause, and bereavement leave.
- Eight complimentary backup-care sessions for emergency childcare or elder care.
- Five weeks of annual leave with the option to buy or sell holiday days.
- At least 40 hours of training annually, including workshops, certifications, and e-learning.
- A business coach assigned from Day One.
- Online GP services, Gympass/Wellhub, travel insurance, Tastecard, season-ticket loans, Cycle to Work, and dental insurance.
Tech Stack
Categories
Data Engineering
About Capco
Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.