Barclays

Cloud Data Engineer

Barclays
Apply
2 days ago
Pune, IndiaSenior

Responsibilities

  • Contribute to cloud data strategy and translate business and analytical requirements into secure, scalable AWS data solutions.
  • Build and support batch and event-driven pipelines using AWS Glue, Step Functions, Lambda, Athena, S3, and EC2.
  • Ingest data from golden-source systems and enterprise sources into governed, source-aligned cloud data layers.
  • Develop curated data models and reusable data products for analytics, reporting, and downstream applications.
  • Design and implement data lake and data warehouse patterns with appropriate partitioning, file formats, metadata, and performance optimization.
  • Develop transformation logic using SQL and Python or PySpark, including testing, validation, reconciliation, and error handling.
  • Implement workflow orchestration, scheduling, monitoring, alerting, restart, and recovery capabilities.
  • Apply data quality, lineage, metadata, security, access-control, retention, encryption, and audit requirements.
  • Optimize workloads for performance, reliability, scalability, and cost.
  • Investigate production issues, perform root-cause analysis, and implement sustainable fixes and preventative controls.
  • Collaborate with data architects, platform engineers, source-system teams, analysts, product owners, and governance stakeholders.
  • Follow engineering standards for source control, peer review, automated testing, CI/CD, documentation, and operational support.

Requirements

  • Relevant data engineering experience designing and delivering production-grade data pipelines and analytical data platforms.
  • Strong SQL skills and understanding of data warehousing, dimensional modeling, data lakes, ETL/ELT patterns, and data lifecycle management.
  • Hands-on AWS experience with AWS Glue, Step Functions, Lambda, Athena, S3, and EC2.
  • Proficiency in Python and/or PySpark for data processing, automation, and integration.
  • Experience ingesting data from relational databases, files, APIs, and other enterprise sources into governed cloud data layers.
  • Experience with reusable ingestion or hydration frameworks and configurable, metadata-driven pipeline patterns.
  • Ability to build curated data products with transformation, validation, reconciliation, and publication for consumers.
  • Knowledge of data quality, metadata, lineage, security, encryption, identity and access management, monitoring, and audit controls.
  • Experience with Git-based source control, automated testing, CI/CD, and deployment across development, test, and production environments.
  • Strong analytical, troubleshooting, documentation, stakeholder-management, written communication, and verbal communication skills.
  • Preferred experience with Databricks, Apache Spark, Delta Lake, notebooks, workflows, and Unity Catalog.
  • Preferred experience with Astronomer or Apache Airflow for workflow orchestration and operational monitoring.
  • Knowledge of Redshift, EMR, Lake Formation, Kinesis, DynamoDB, CloudWatch, IAM, and CloudFormation is desirable.
  • Experience with Terraform or CloudFormation and familiarity with data mesh, data products, data observability, schema evolution, data contracts, and cloud cost optimization are desirable.
  • Relevant AWS or Databricks certification and banking or financial-services experience are desirable.
  • Ability to work within enterprise risk, security, compliance, and control frameworks.

Benefits

  • The role is based in Pune.

Tech Stack

Amazon DynamoDBAmazon RedshiftApache AirflowApache SparkAWSDatabricksGitPythonSQLTerraform

Categories

Data Engineering
Barclays

About Barclays

10,000+ employees

Barclays is a UK‑based universal bank that provides retail and commercial banking, credit cards (Barclaycard), wealth management, and investment banking to consumers, businesses, and institutions. Publicly listed in London and New York, it generates revenue from net interest income, fees, and markets activities, and operates across Europe, the Americas, the Middle East, and Asia. Founded in 1690 and headquartered in London, it serves customers through digital channels and a branch network.

Contact me