Barclays

Data Engineer - PySpark Developer

Barclays
Apply
3 days ago
Bengaluru, IndiaStaff+

Responsibilities

  • Design, develop, and maintain scalable data pipelines using PySpark.
  • Build and optimize ETL/ELT solutions for large-scale enterprise data processing.
  • Develop reusable frameworks, components, and standards for data onboarding and analytics delivery.
  • Implement data quality controls, validation frameworks, and reconciliation processes.
  • Design and implement data warehouses, data lakes, and modern data platform architectures.
  • Deliver secure, reliable, performant, and well-tested data products.
  • Collaborate with business stakeholders, architects, product owners, data scientists, and engineering teams.
  • Support machine learning model development and deployment in collaboration with data scientists.
  • Manage risk, strengthen controls, and contribute to governance, policy, and operational effectiveness.
  • Lead complex assignments or teams and guide colleagues where leadership responsibilities apply.

Requirements

  • Strong programming skills in Python and PySpark.
  • Hands-on experience with Databricks and/or Snowflake.
  • Strong experience with AWS services including S3, Glue, EMR, Lambda, EC2, DynamoDB, IAM, CloudWatch, and CloudTrail.
  • Hands-on experience developing and optimizing AWS Glue ETL jobs using PySpark.
  • Experience with large-scale distributed data processing.
  • Solid understanding of data lake, lakehouse, and modern data platform architectures.
  • Expertise with Git-based source control platforms.
  • Experience with Airflow.
  • Ability to produce high-quality code using engineering standards and automated testing approaches.
  • Ability to collaborate with stakeholders and communicate complex information.
  • Capability to advise on risk and controls, change and transformation, business acumen, strategic thinking, and digital and technology.

Benefits

  • The role is based in Bengaluru.

Tech Stack

Amazon DynamoDBApache AirflowAWSDatabricksGitPythonSnowflake

Categories

Data Engineering
Barclays

About Barclays

10,000+ employees

Barclays is a UK‑based universal bank that provides retail and commercial banking, credit cards (Barclaycard), wealth management, and investment banking to consumers, businesses, and institutions. Publicly listed in London and New York, it generates revenue from net interest income, fees, and markets activities, and operates across Europe, the Americas, the Middle East, and Asia. Founded in 1690 and headquartered in London, it serves customers through digital channels and a branch network.

Contact me