Senior Data Engineer
Commonwealth Bank of Australia6 days ago
Bengaluru, IndiaSenior
Responsibilities
- Contribute to the full development lifecycle, including requirements analysis, functional and technical design, programming, testing, documentation, implementation, and ongoing technical support.
- Design and build cloud data platforms and enterprise data ingestion, integration, transformation, and pipeline solutions.
- Develop data transformations, cleansing, aggregation, ETL strategies, dbt models, PySpark jobs, and complex SQL.
- Use Snowflake, AWS, dbt, PySpark, Teradata, Oracle, and enterprise ETL tools to deliver data solutions.
- Perform testing, code reviews, debugging, performance optimization, root cause analysis, and production troubleshooting.
- Implement data quality validation, cleansing, reconciliation, and automation frameworks.
- Create technology blueprints and engineering roadmaps for multi-year data transformation initiatives.
- Lead or participate in ETL strategy and technical solution definition and communication.
- Collaborate with business users, operational users, data management staff, infrastructure teams, consultants, and internal stakeholders.
- Lead and mentor data engineers and improve development processes to accelerate delivery, reduce cost, and improve quality.
Requirements
- Bachelor’s degree in Engineering, Computer Science, or Information Technology.
- 8+ years of experience designing or developing analytics and data warehousing projects.
- Preferably at least 8 years of hands-on experience in data engineering.
- Hands-on experience designing and building Snowflake data solutions, including virtual warehouses, streams, tasks, Snowpipe, time travel, and performance optimization.
- Strong experience building modular, tested, and documented dbt transformation models, including incremental models and CI/CD-driven workflows.
- Hands-on AWS cloud data engineering experience with services such as S3, Glue, EMR, Lambda, Step Functions or MWAA, EventBridge, SQS, Kinesis, MSK/Kafka, Redshift, Athena, Iceberg, and IAM.
- Proven experience developing scalable distributed data processing pipelines with PySpark.
- Advanced SQL skills for data transformation, analysis, pipeline development, performance tuning, and database programming.
- Solid Teradata data warehousing experience, including utilities, query performance tuning, and data modeling.
- Experience with enterprise ETL tools such as Ab-Initio, DataStage, GDE, Express-IT, Control centre, Mhub, and Conduct-IT.
- Experience building enterprise-wide data ingestion, integration, and pipeline solutions using Big Data and data warehouse platforms.
- Experience with Unix/Linux shell scripting and programming.
- Experience leading and mentoring data engineers and managing internal business stakeholder relationships.
- Experience with development, production support, troubleshooting, process optimization, automation, APIs, and file transfers.
- Knowledge of DevSecOps practices and tools, including CI/CD for dbt models and data pipelines.
- Experience using AI tools such as Claude, Roo, or Cline.
- AWS certification, such as AWS Certified Data Engineer, is preferred.
- Preferably 3+ years of hands-on AWS cloud data engineering experience.
Benefits
- The role is based at Manyata Tech Park in Bangalore.
- Applications are advertised through 29 November 2026.
- Accessibility support is available through HR Direct for applicants who require assistance.
Tech Stack
Categories
Data Engineering
About Commonwealth Bank of Australia
Commonwealth Bank of Australia is an ASX-listed bank headquartered in Sydney that provides retail, business, and institutional banking, payments, and wealth services across Australia. Its offerings include transaction and savings accounts, home and business lending, cards, merchant services, digital banking, superannuation, and investment platforms such as CommSec. Founded in 1911, the bank serves millions of customers through branches, contact centres, and online channels.