Data Engineer - (AWS Data Services)
ASX Limited28 days ago
Sydney, AustraliaSenior
Responsibilities
- Collaborate with stakeholders and data owners to understand data objectives and drive adoption and evolution of the central data platform.
- Ingest ASX core data assets and curate them into source-aligned data products.
- Create consumable data products in the form of files, reports, dashboards, and APIs.
- Design and build automated, reliable data pipelines and products for a critical market infrastructure environment.
- Contribute to data engineering standards, frameworks, best practices, and community practices.
- Support real-time streaming, data management, analytics, and data distribution across domain-aligned data product teams.
Requirements
- Hands-on experience with a variety of AWS services for data ingestion, curation, storage, orchestration, data management, analytics, and distribution.
- Good knowledge of data modelling and structuring data in data warehousing environments according to data management best practices.
- Experience with data product architecture, solution design, and DevSecOps practices for automating complex data pipelines.
- Experience with real-time streaming using Kafka and AWS services.
- Experience with Airflow, AWS Glue, Apache Iceberg, Athena, Redshift, and DataZone.
- Experience with data visualization tools such as Tableau, Power BI, or QuickSight.
- Solid experience with Python, Spark, and Terraform or Terragrunt.
- Experience with platform/product operating models, reusable frameworks, and development kits is desirable.
- Working knowledge of data mesh and data product concepts with federated domain-level ownership is desirable.
- Capital markets experience and understanding of derivative products are desirable.
- Candidates must be legally authorised to work in Australia permanently without restrictions.
Benefits
- Flexible working and hybrid working options are available.
- Part-time and other flexible working arrangements may be considered even where roles are advertised as full-time.
- Background checks, including reference and police checks, are completed during onboarding.
- ASX supports diversity, inclusion, employee-led networks, wellbeing, accessibility, volunteering, and cultural and religious events.
Tech Stack
Categories
Data Engineering
About ASX Limited
ASX Limited operates Australia’s primary securities exchange, providing listing, trading, clearing, settlement, market data, and connectivity across equities, derivatives, ETFs, and fixed income. It earns fees from listings, transactions, post‑trade services, and data/technology services for brokers, issuers, and investors. Founded in 1987 and headquartered in Sydney, ASX runs central counterparty clearing and depository infrastructure and is widely ranked among the world’s larger exchanges by market capitalization.