Staff Data Engineer (AWS, Java & Real-Time Data)
Commonwealth Bank of Australia1 day ago
Sydney, Australia or Melbourne, AustraliaStaff+
Responsibilities
- Lead conceptual, logical, and physical data modeling for the new Credit Risk Profile service domain.
- Design, build, and operate batch and near-real-time ingestion and data-processing pipelines.
- Establish engineering standards, reusable patterns, architectural guardrails, and technical decisions.
- Develop trusted data products with data quality controls, metadata, lineage, access controls, and governance.
- Guide migration from legacy data assets to modern cloud-based services.
- Build automated testing, continuous delivery, monitoring, and observability into the engineering lifecycle.
- Influence technical decisions across engineering, architecture, and product teams while balancing delivery, resilience, security, and cost.
- Mentor engineers and contribute to an inclusive engineering culture.
Requirements
- Strong Java engineering capability for production-grade data ingestion, event-streaming, and processing solutions.
- Experience designing and delivering AWS-based data solutions, including services and technologies such as Glue Catalog, S3, Iceberg, Kinesis, MSK or Kafka, Lambda, and PostgreSQL.
- Understanding of change data capture, event-driven ingestion, windowing, checkpointing, schema evolution, replay, and operational recovery.
- Strong data modeling and database capability, including SQL, partitioning, stored procedures, and conceptual, logical, and physical modeling.
- Experience with Apache Flink or transferable experience with Spark Streaming or another distributed stream-processing framework.
- Experience applying GitHub Actions, CI/CD, automated testing, DevSecOps, and source control practices.
- Experience with production monitoring, logging, alerting, and observability platforms such as CloudWatch, Grafana, Splunk, or Datadog.
- Ability to set technical direction, influence stakeholders, and mentor engineers across complex programs or initiatives.
- Experience with Python, Parquet, data replication, data quality, enterprise semantic models, or regulated data environments is valued.
- Relevant AWS or data engineering certifications are welcome but not essential where equivalent practical experience can be demonstrated.
Benefits
- Inclusive and respectful workplace with support and adjustments available for applicants who need them.
- Applications are welcomed from people of all backgrounds, with particular commitment to Aboriginal and/or Torres Strait Islander Peoples.
- Accessibility support is available through the listed support contacts.
- Advertising end date: 19/09/2026.
Tech Stack
Categories
Data Engineering
About Commonwealth Bank of Australia
Commonwealth Bank of Australia is an ASX-listed bank headquartered in Sydney that provides retail, business, and institutional banking, payments, and wealth services across Australia. Its offerings include transaction and savings accounts, home and business lending, cards, merchant services, digital banking, superannuation, and investment platforms such as CommSec. Founded in 1911, the bank serves millions of customers through branches, contact centres, and online channels.