8 hours ago
Pune, IndiaSenior
Responsibilities
- Build and maintain data architectures and pipelines for transferring and processing durable, complete, and consistent data.
- Design and implement secure data warehouses and data lakes for required data volumes and velocity.
- Develop processing and analysis algorithms appropriate for data complexity and volume.
- Build and manage scalable, secure infrastructure and deployment pipelines using AWS and related technologies.
- Collaborate with data scientists to build and deploy machine learning models.
- Provide technical guidance, coordinate resources, and potentially lead and supervise team members.
- Manage operational risks, embed procedures and controls, and advise stakeholders on technical decisions.
Requirements
- Senior-level experience and in-depth technical knowledge in data engineering or a related technical area.
- Hands-on AWS experience with S3, EC2, Lambda, RDS, Glue, Athena, data pipelines, and Step Functions.
- Experience with distributed computing architecture and core Hadoop components including HDFS, Spark, YARN, Hive, and Impala.
- Expertise in SQL and advanced SQL skills.
- Expertise in shell scripting and programming with Scala or Python.
- Knowledge of ETL technologies, preferably Ab Initio.
- Experience designing ETL, Hadoop, and AWS components.
- Knowledge of data warehousing.
- Ability to manage risk and controls, support change and transformation, demonstrate business acumen and strategic thinking, and communicate complex information.
Benefits
- The role is based in Pune.
Tech Stack
Categories
Data Engineering
About Barclays
Our vision is to be the UK-centred leader in global finance. We are a diversified bank with comprehensive UK consumer, corporate and wealth and private banking franchises, a leading investment bank and a strong, specialist US consumer bank. Through these five divisions, we are working together for a better financial future for our customers, clients, and communities. For further information about Barclays, please visit home.barclays.