4 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark.
- Build and optimize ETL/ELT solutions for large-scale enterprise data processing.
- Develop reusable frameworks, components, and standards for data onboarding and analytics delivery.
- Implement data quality controls, validation frameworks, and reconciliation processes.
- Build and maintain data architectures, data warehouses, data lakes, and related processing systems.
- Deliver secure, reliable, performant data products and support large-scale data transformation initiatives.
- Collaborate with business stakeholders, architects, product owners, data scientists, and engineering teams.
- Write high-quality code using engineering standards and automated testing approaches.
- Support risk management, controls, governance, and operational effectiveness.
- Lead or guide complex collaborative assignments and contribute to policy and process development.
Requirements
- Strong expertise in PySpark and Python programming.
- Experience designing and maintaining scalable data pipelines.
- Experience building and optimizing ETL/ELT solutions for large-scale data processing.
- Experience with AWS cloud technologies and modern data platform architectures.
- Hands-on experience with Databricks and/or Snowflake is valued.
- Experience with AWS S3, Glue, EMR, Lambda, EC2, DynamoDB, IAM, CloudWatch, and CloudTrail is valued.
- Experience developing and optimizing AWS Glue ETL jobs using PySpark is valued.
- Experience with large-scale distributed data processing, data lakes, lakehouses, and modern data platforms.
- Experience with Git-based source control platforms and Airflow is valued.
- Ability to collaborate across business, architecture, product, and engineering functions and communicate complex information.
- Ability to manage risk, strengthen controls, influence stakeholders, and support change and transformation.
About Barclays
Barclays is a UK‑based universal bank that provides retail and commercial banking, credit cards (Barclaycard), wealth management, and investment banking to consumers, businesses, and institutions. Publicly listed in London and New York, it generates revenue from net interest income, fees, and markets activities, and operates across Europe, the Americas, the Middle East, and Asia. Founded in 1690 and headquartered in London, it serves customers through digital channels and a branch network.