3 days ago
Manchester, United Kingdom +3 moreMid Level
Responsibilities
- Build and maintain batch and streaming data pipelines and data products using ETL/ELT and distributed processing.
- Prepare governed datasets, features, retrieval pipelines, embeddings, vector stores, metadata, and context for AI and agent workflows.
- Apply data modelling, validation, quality checks, lineage, documentation, logging, alerting, and production SLAs.
- Contribute to monitoring and evaluation of AI-facing data and outputs, including drift, retrieval quality, and anomaly detection.
- Use AI coding assistants responsibly while protecting confidential data and maintaining human ownership of outcomes.
- Collaborate with business analysts, platform engineers, data scientists, and DevOps on secure, tested solutions.
- Use version control, code review, automated testing, and CI/CD, and contribute to engineering standards and accelerators.
Requirements
- Hands-on experience delivering production data pipelines and data platforms.
- Strong Python and SQL skills, sound software engineering practices, and the ability to troubleshoot production issues.
- Experience with distributed data processing, lakehouse or warehouse patterns, data modelling, and performance optimization.
- Experience with cloud data services for storage, compute, and orchestration on at least one major cloud.
- Practical experience using AI coding assistants in an engineering workflow with awareness of data confidentiality and responsible use.
- Clear communication with technical and non-technical colleagues and a continuous-learning mindset.
- Exposure to RAG, embeddings, vector search, LLM orchestration, LLM evaluation or observability, streaming, or event-driven systems is preferred.
- Relevant cloud or data engineering certifications are preferred.
- Must be eligible to obtain UK Security Check (SC) or Developed Vetting (DV) clearance; some posts may be restricted to sole UK Nationals.
Benefits
- Hybrid working across company offices, client sites, and home, with no option to work from home 100% of the time.
- Flexible working arrangements are available to UK employees.
- Training and development opportunities including thinktanks, hackathons, up to 250,000 courses, and external certifications.
- Pre-employment checks include identity, nationality or immigration status, three years of employment history, and an unspent criminal record check.
Tech Stack
Amazon RedshiftApache KafkaApache SparkAWSAzureDatabricksGitGoogle Cloud PlatformMLflowPythonSnowflakeSQL
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.
