Barclays

Data Engineer

Barclays
Apply
1 day ago
Pune, India or Bengaluru, IndiaSenior

Responsibilities

  • Design, develop, and operate secure, scalable, and reusable data products and pipelines.
  • Transform data from multiple source systems into trusted, model-ready datasets and retrieval-ready knowledge assets.
  • Build ETL/ELT pipelines, data models, and reusable components for structured, semi-structured, and unstructured data.
  • Support the end-to-end lifecycle from requirements and solution design through testing, deployment, monitoring, and production support.
  • Implement data quality, metadata, lineage, security, privacy, retention, access control, and audit requirements.
  • Apply modular programming, error handling, logging, testing, and performance optimization practices.
  • Collaborate with product managers, designers, engineers, stakeholders, and related teams to define requirements and solutions.
  • Participate in code reviews, knowledge sharing, risk management, control strengthening, and continuous improvement.
  • Guide or supervise team members where applicable and advise stakeholders within the area of expertise.

Requirements

  • Strong programming skills in Python and PySpark, including modular design, error handling, logging, testing, and performance optimization.
  • Hands-on experience with AWS data and machine learning services including S3, Glue, Lambda, EC2, ECR, SageMaker, Step Functions, EventBridge, and CloudWatch, or equivalent services on another cloud platform.
  • Experience with ETL/ELT pipelines, data modeling, and reusable data components for structured, semi-structured, and unstructured data.
  • Experience with GitLab, automated testing, CI/CD, environment configuration, and Infrastructure as Code.
  • Knowledge of ReactJS or other frontend technologies.
  • Practical knowledge of machine learning data pipelines and foundational knowledge of GenAI, RAG, and AI Agent architectures.
  • Knowledge of Apache Spark, Spark SQL, Hive, and the Hadoop ecosystem, including distributed processing, partitioning, file formats, and query optimization.
  • Graduate degree or equivalent practical experience in Computer Science, Engineering, Information Technology, Mathematics, or a related discipline.
  • Experience in banking or financial services and awareness of regulated data, risk, and control expectations is valued.
  • Exposure to Azure, Google Cloud, Databricks, modern lakehouse platforms, Kafka, Airflow, Control-M/TWS, or other event-streaming and orchestration tools is valued.
  • Experience with MLflow, SageMaker, feature stores, model registries, experiment tracking, or MLOps practices is valued.
  • Experience with unstructured data processing, document intelligence, search platforms, embedding pipelines, vector databases, GenAI observability and evaluation tooling, prompt/version management, guardrails, or responsible AI controls is valued.
  • Knowledge of API design, microservices, containers, Kubernetes, and secure integration patterns is valued.
  • Relevant cloud, data engineering, or machine learning certification is beneficial.
  • Ability to demonstrate risk and controls, change and transformation, business acumen, strategic thinking, digital and technology, and job-specific technical skills.

Benefits

  • The role is based in the Pune and Bengaluru offices.

Tech Stack

Apache AirflowApache HadoopApache HiveApache KafkaApache SparkAWSAzureDatabricksGoogle CloudKubernetesMLflowPythonReact

Categories

Data Engineering
Barclays

About Barclays

10,000+ employees

Barclays is a UK‑based universal bank that provides retail and commercial banking, credit cards (Barclaycard), wealth management, and investment banking to consumers, businesses, and institutions. Publicly listed in London and New York, it generates revenue from net interest income, fees, and markets activities, and operates across Europe, the Americas, the Middle East, and Asia. Founded in 1690 and headquartered in London, it serves customers through digital channels and a branch network.

Contact me