Staff Data Engineer
Commonwealth Bank of Australia2 hours ago
Bengaluru, IndiaStaff+
Responsibilities
- Translate customer business objectives into robust, end-to-end data-centric solutions.
- Define, design, and execute data engineering, ETL, staging, architecture, integration, and application interface strategies.
- Design and develop reliable, secure, scalable data pipelines, platforms, and data products with comprehensive test coverage.
- Create technical solutions and data consumption patterns for complex business requirements.
- Participate across the full agile delivery lifecycle from ideation and planning through implementation.
- Partner with business, operational, infrastructure, product, and engineering teams to improve service scalability, reliability, and compliance.
- Provide data engineering expertise and technical leadership across platforms, products, delivery teams, and strategic data programs.
- Drive engineering maturity through reusable frameworks, tooling, automation, and improvements to delivery practices.
- Mentor engineers and contribute to technical discussions, documentation, and engineering communities.
- Own nominated technical assets, roadmaps, and technical direction, and participate in on-call rosters to resolve critical issues.
Requirements
- 10+ years of experience designing or developing analytics and data warehousing projects.
- Experience building end-to-end solutions with big data platforms, Apache Spark or Scala, Apache Flink, and Kafka for real-time and batch data.
- Experience designing and building reliable, scalable data pipelines in the AWS cloud ecosystem.
- Strong experience building ETL pipelines with Spark or Scala and developing UNIX shell scripts and Oracle SQL/PL-SQL.
- Strong Python and PySpark skills for data manipulation, API integration, and automation, alongside Scala.
- Experience with Oracle SQL database programming, SQL performance tuning, relational model analysis, advanced SQL, and dimensional data modeling.
- Extensive experience with Teradata data warehouses and Cloudera Hadoop.
- Proficiency with enterprise analytics, business intelligence, data warehousing, and ETL technologies including Teradata Control Framework, Tableau, OBIEE, SAS, Apache Spark, and Hive.
- Experience with data observability tools for real-time data quality and pipeline performance monitoring.
- Experience with AI/ML integrations, AI infrastructure, vector databases, and embeddings is beneficial.
- Experience with GenAI frameworks such as LangChain, Llama, and Hugging Face is highly desirable.
- A bachelor’s or master’s degree in engineering, Computer Science, or Information Technology.
Benefits
- The role is based at CommBank’s Manyata Tech Park location in Bangalore.
- The position reports to an Engineering Manager within Business Banking - EBB.
- The role offers technical leadership, mentoring, and strategic influence across enterprise engineering teams.
- Applicants who are already part of the Commonwealth Bank Group must apply through Sidekick.
- Accessibility support is available through HR Direct.
Tech Stack
Categories
Data Engineering
About Commonwealth Bank of Australia
Australia’s leading provider of financial services including retail, premium, business and institutional banking, funds management, superannuation, insurance, investment and sharebroking products and services. We are a business with more than 800,000 shareholders and over 52,000 employees. We offer a full range of financial services to help all Australians build and manage their finances. Connect with us, we'd like to hear from you: facebook.com/commonwealthbank twitter.com/commbank youtube.com/commbank youtube.com/commbankbusiness instagram.com/commbank Our Community Guidelines can be found at: https://www.commbank.com.au/support/social-networks.html For information on our Privacy Policy visit https://www.commbank.com.au/support/privacy