Senior Data Engineer
Commonwealth Bank of Australia3 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for batch and real-time data processing.
- Build reusable data solutions and optimize data ingestion, transformation, and data-serving frameworks.
- Build and support cloud-native data platforms using AWS services.
- Develop data processing solutions using AWS Glue, S3, Athena, Lambda, Redshift, EKS, and DynamoDB.
- Implement data quality controls, monitoring, validation, metadata management, data lineage, and governance initiatives.
- Support infrastructure automation and platform modernization initiatives.
- Collaborate with architects, product owners, business analysts, stakeholders, and engineering teams on solution design and delivery.
- Build and maintain automated CI/CD pipelines and implement observability, logging, monitoring, and alerting solutions.
- Ensure data quality, integrity, reliability, availability, security, privacy, and regulatory compliance.
Requirements
- 6–9 years of experience in data engineering, software engineering, or a related discipline.
- Strong programming skills in Python, Java, or Scala, with Scala preferred.
- Strong experience with AWS cloud services.
- Experience with containerization and orchestration using Docker and Kubernetes/EKS.
- Experience with Apache Spark and Kafka.
- Bachelor of Engineering degree.
Benefits
- The position is located in Bangalore at Manyata Tech Park.
- Commonwealth Bank Group employees, including Bankwest and x15ventures employees, must apply through Sidekick.
- Accessibility support is available through HR Direct.
Tech Stack
Categories
Data EngineeringDevOps
About Commonwealth Bank of Australia
Commonwealth Bank of Australia is an ASX-listed bank headquartered in Sydney that provides retail, business, and institutional banking, payments, and wealth services across Australia. Its offerings include transaction and savings accounts, home and business lending, cards, merchant services, digital banking, superannuation, and investment platforms such as CommSec. Founded in 1911, the bank serves millions of customers through branches, contact centres, and online channels.