Staff Data Engineer
Commonwealth Bank of Australia2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Translate customer business objectives into robust, end-to-end data-centric solutions.
- Define, design, and execute data engineering, ETL, staging, architecture, integration, and application interface strategies.
- Design and develop reliable, secure, scalable data pipelines, platforms, and data products with comprehensive test coverage.
- Create technical solutions and data consumption patterns for complex business requirements.
- Participate across the full agile delivery lifecycle from ideation and planning through implementation.
- Partner with business, operational, infrastructure, product, and engineering teams to improve service scalability, reliability, and compliance.
- Provide data engineering expertise and technical leadership across platforms, products, delivery teams, and strategic data programs.
- Drive engineering maturity through reusable frameworks, tooling, automation, and improvements to delivery practices.
- Mentor engineers and contribute to technical discussions, documentation, and engineering communities.
- Own nominated technical assets, roadmaps, and technical direction, and participate in on-call rosters to resolve critical issues.
Requirements
- 10+ years of experience designing or developing analytics and data warehousing projects.
- Experience building end-to-end solutions with big data platforms, Apache Spark or Scala, Apache Flink, and Kafka for real-time and batch data.
- Experience designing and building reliable, scalable data pipelines in the AWS cloud ecosystem.
- Strong experience building ETL pipelines with Spark or Scala and developing UNIX shell scripts and Oracle SQL/PL-SQL.
- Strong Python and PySpark skills for data manipulation, API integration, and automation, alongside Scala.
- Experience with Oracle SQL database programming, SQL performance tuning, relational model analysis, advanced SQL, and dimensional data modeling.
- Extensive experience with Teradata data warehouses and Cloudera Hadoop.
- Proficiency with enterprise analytics, business intelligence, data warehousing, and ETL technologies including Teradata Control Framework, Tableau, OBIEE, SAS, Apache Spark, and Hive.
- Experience with data observability tools for real-time data quality and pipeline performance monitoring.
- Experience with AI/ML integrations, AI infrastructure, vector databases, and embeddings is beneficial.
- Experience with GenAI frameworks such as LangChain, Llama, and Hugging Face is highly desirable.
- A bachelor’s or master’s degree in engineering, Computer Science, or Information Technology.
Benefits
- The role is based at CommBank’s Manyata Tech Park location in Bangalore.
- The position reports to an Engineering Manager within Business Banking - EBB.
- The role offers technical leadership, mentoring, and strategic influence across enterprise engineering teams.
- Applicants who are already part of the Commonwealth Bank Group must apply through Sidekick.
- Accessibility support is available through HR Direct.
Tech Stack
Categories
Data Engineering
About Commonwealth Bank of Australia
Commonwealth Bank of Australia is an ASX-listed bank headquartered in Sydney that provides retail, business, and institutional banking, payments, and wealth services across Australia. Its offerings include transaction and savings accounts, home and business lending, cards, merchant services, digital banking, superannuation, and investment platforms such as CommSec. Founded in 1911, the bank serves millions of customers through branches, contact centres, and online channels.