Data Engineer - AWS
ASX Limited1 month ago
Sydney, AustraliaSenior
Responsibilities
- Collaborate with stakeholders and data owners to understand data objectives and evolve the central data platform.
- Ingest ASX core data assets and curate them into source-aligned data products.
- Create consumable data products including files, reports, dashboards, and APIs.
- Design and build data pipelines and products suitable for operation within a critical market infrastructure environment.
- Develop and promote data engineering standards, frameworks, and best practices.
- Support data modelling, architecture, solution design, automation, and real-time data streaming.
Requirements
- Hands-on experience with a variety of AWS services for data ingestion, curation, storage, orchestration, management, analytics, and distribution.
- Good knowledge of data modelling and structuring data in data warehousing environments.
- Experience with data product architecture, solution design, and DevSecOps practices for automating complex data pipelines.
- Experience with real-time streaming using Confluent Kafka and AWS services.
- Experience with Airflow, AWS Glue, Apache Iceberg, Athena, Redshift, and DataZone.
- Experience with Tableau, Power BI, or QuickSight for data visualization.
- Solid experience with Python, Spark, and Terraform or Terragrunt.
- Candidates must be legally authorised to work permanently in Australia without restrictions; successful candidates will undergo background, reference, and police checks.
Benefits
- Flexible working and hybrid working options are available.
- Part-time and other flexible working arrangements may be considered even when roles are advertised as full-time.
- The employer supports diversity, inclusion, employee networks, wellbeing, giving, and volunteering.
- Background, reference, and police checks are part of onboarding for successful candidates.
Tech Stack
Categories
Data Engineering
About ASX Limited
ASX Limited operates Australia’s primary securities exchange, providing listing, trading, clearing, settlement, market data, and connectivity across equities, derivatives, ETFs, and fixed income. It earns fees from listings, transactions, post‑trade services, and data/technology services for brokers, issuers, and investors. Founded in 1987 and headquartered in Sydney, ASX runs central counterparty clearing and depository infrastructure and is widely ranked among the world’s larger exchanges by market capitalization.