Principal Data Engineer (AWS)
Commonwealth Bank of Australia14 hours ago
Sydney, Australia +2 moreStaff+
Responsibilities
- Define and drive the platform strategy for capital provisioning modelling.
- Architect and build AWS cloud-native platforms supporting data and model workloads.
- Design solutions that consume and operationalise enterprise data marketplace assets.
- Lead engineering patterns for model and ML deployment, orchestration, and monitoring.
- Drive migration from legacy platforms to strategic and governed environments.
- Embed data lineage, traceability, reproducibility, controls, and validation into platforms.
- Partner with modelling teams to productionise models and improve reliability and performance.
- Influence architecture and engineering decisions across crews and domains.
- Set and uplift engineering standards and practices.
- Mentor engineers and contribute to a high-performing engineering culture.
Requirements
- Strong experience building cloud-native data and model platforms at scale.
- Experience productionising models or ML workloads.
- Experience building frameworks and tools that improve engineering productivity.
- Understanding of data integrity, reconciliation, and accuracy in financial systems.
- Ability to influence across teams and align stakeholders on technical direction.
- Ability to educate, communicate, and coordinate with internal stakeholders and consultants.
- Comfort balancing technical debt with long-term platform strategy.
- Experience or exposure to AWS services including S3, EMR, Glue, Lambda, Redshift, and SageMaker, or equivalent technologies.
- Experience with Snowflake or enterprise data platforms and data marketplace patterns.
- Experience with Python, PySpark, distributed data processing, batch and streaming pipelines, SQL, and relational databases.
Benefits
- Flexible work locations with at least half of each month spent connecting in the office.
- Technology hubs are available in Melbourne and Perth, with applications accepted from across Australia.
- Flexible working options include adjustable start and finish times, part-time arrangements, and job sharing.
- Inclusive and respectful workplace with support for professional challenges and new opportunities.
Tech Stack
Categories
Data EngineeringML Engineering
About Commonwealth Bank of Australia
Commonwealth Bank of Australia is an ASX-listed bank headquartered in Sydney that provides retail, business, and institutional banking, payments, and wealth services across Australia. Its offerings include transaction and savings accounts, home and business lending, cards, merchant services, digital banking, superannuation, and investment platforms such as CommSec. Founded in 1911, the bank serves millions of customers through branches, contact centres, and online channels.