Capgemini

Data Engineer - National Security

Capgemini
Apply
6 days ago
Manchester, United Kingdom +2 moreSenior

Responsibilities

  • Develop modular, maintainable data components for analytical, operational, and AI use cases, including built-in testing and observability.
  • Design ingestion and event-driven architectures for reliable real-time and near-real-time data flows.
  • Define and operate data workflows as code with dependency management, scheduling, and error recovery.
  • Package, deploy, and monitor ML, GenAI, and agentic workloads, including self-hosted models, RAG, vector search, guardrails, evaluation, and human oversight.
  • Containerize services and deploy them to secure Kubernetes and cloud environments using high-assurance CI/CD.
  • Implement monitoring, structured logging, metrics, lineage, auditability, security, and graceful failure or self-healing behavior.
  • Provision infrastructure as code in alignment with accredited platform architectures.
  • Create demonstrations, technical deep-dives, reusable secure data-delivery assets, and internal thought leadership as the national-security practice grows.

Requirements

  • Expert-level Python and strong software engineering foundations, including object-oriented design, automated testing, and version control.
  • Hands-on experience delivering production data pipelines and platforms.
  • Experience with streaming frameworks, distributed processing, and relational or analytical storage such as Kafka, Spark, and PostgreSQL.
  • Experience with AWS data and AI services including Glue, Lambda, Step Functions, Kinesis, EMR, Athena, Redshift, S3, Amazon Bedrock, and Knowledge Bases for Bedrock.
  • Familiarity with workflow frameworks such as Airflow, Dagster, or Prefect.
  • Experience with data testing, documentation, and lineage tools such as Great Expectations or dbt.
  • Understanding of production MLOps and emerging LLMOps, including packaging, monitoring, controlled deployment, evaluation, guardrails, and observability.
  • Experience with Docker, Kubernetes, and hands-on CI/CD using tools such as GitLab CI, GitHub Actions, or Argo.
  • Motivation to work on technology serving the national interest.
  • Infrastructure-as-code or configuration-management experience, secure or air-gapped environment experience, GenAI building-block experience, AI coding-assistant experience within strict security boundaries, Anthropic model experience, lakehouse and NoSQL knowledge, and API gateway or integration-pattern familiarity are desirable.
  • Must be a UK passport holder, eligible and willing to undergo DV vetting; existing DV clearance is desirable and DV vetting normally requires 10 years of UK residency.

Benefits

  • Capgemini will sponsor the required DV security clearance.
  • Most work is on-site at secure locations in London, with consideration for Manchester or Gloucester and some remote working where the work permits.
  • Hybrid working blends company offices, client sites, and home working, but the role cannot be 100% home-based.
  • Flexible working arrangements are available to UK employees.
  • Training and development include vendor certifications, a curated learning framework, thinktanks, hackathons, and access to 250,000 courses, including AWS, Microsoft, Harvard Manage Mentor, and cybersecurity qualifications.
  • Pre-employment checks include identity, nationality or immigration status, three years of employment history, and an unspent criminal record check.

Tech Stack

Amazon RedshiftAnsibleApache AirflowApache KafkaApache SparkArgo CDAWSdbtDockerGitHub ActionsGitLab CI/CDKubernetesPostgreSQLPythonTerraform

Categories

Data Engineering
Capgemini

About Capgemini

10,000+ employees

Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.

Contact me