6 days ago
Manchester, United Kingdom +2 moreSenior
Responsibilities
- Develop modular, maintainable data components for analytical, operational, and AI use cases, including built-in testing and observability.
- Design ingestion and event-driven architectures for reliable real-time and near-real-time data flows.
- Define and operate data workflows as code with dependency management, scheduling, and error recovery.
- Package, deploy, and monitor ML, GenAI, and agentic workloads, including self-hosted models, RAG, vector search, guardrails, evaluation, and human oversight.
- Containerize services and deploy them to secure Kubernetes and cloud environments using high-assurance CI/CD.
- Implement monitoring, structured logging, metrics, lineage, auditability, security, and graceful failure or self-healing behavior.
- Provision infrastructure as code in alignment with accredited platform architectures.
- Create demonstrations, technical deep-dives, reusable secure data-delivery assets, and internal thought leadership as the national-security practice grows.
Requirements
- Expert-level Python and strong software engineering foundations, including object-oriented design, automated testing, and version control.
- Hands-on experience delivering production data pipelines and platforms.
- Experience with streaming frameworks, distributed processing, and relational or analytical storage such as Kafka, Spark, and PostgreSQL.
- Experience with AWS data and AI services including Glue, Lambda, Step Functions, Kinesis, EMR, Athena, Redshift, S3, Amazon Bedrock, and Knowledge Bases for Bedrock.
- Familiarity with workflow frameworks such as Airflow, Dagster, or Prefect.
- Experience with data testing, documentation, and lineage tools such as Great Expectations or dbt.
- Understanding of production MLOps and emerging LLMOps, including packaging, monitoring, controlled deployment, evaluation, guardrails, and observability.
- Experience with Docker, Kubernetes, and hands-on CI/CD using tools such as GitLab CI, GitHub Actions, or Argo.
- Motivation to work on technology serving the national interest.
- Infrastructure-as-code or configuration-management experience, secure or air-gapped environment experience, GenAI building-block experience, AI coding-assistant experience within strict security boundaries, Anthropic model experience, lakehouse and NoSQL knowledge, and API gateway or integration-pattern familiarity are desirable.
- Must be a UK passport holder, eligible and willing to undergo DV vetting; existing DV clearance is desirable and DV vetting normally requires 10 years of UK residency.
Benefits
- Capgemini will sponsor the required DV security clearance.
- Most work is on-site at secure locations in London, with consideration for Manchester or Gloucester and some remote working where the work permits.
- Hybrid working blends company offices, client sites, and home working, but the role cannot be 100% home-based.
- Flexible working arrangements are available to UK employees.
- Training and development include vendor certifications, a curated learning framework, thinktanks, hackathons, and access to 250,000 courses, including AWS, Microsoft, Harvard Manage Mentor, and cybersecurity qualifications.
- Pre-employment checks include identity, nationality or immigration status, three years of employment history, and an unspent criminal record check.
Tech Stack
Amazon RedshiftAnsibleApache AirflowApache KafkaApache SparkArgo CDAWSdbtDockerGitHub ActionsGitLab CI/CDKubernetesPostgreSQLPythonTerraform
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.
