Senior Data Engineer
Ippon Technologiesalmost 4 years ago
Melbourne, AustraliaSenior
Responsibilities
- Design, build, test, and implement data transformation and processing pipelines.
- Gather business requirements and support data sourcing, extraction, manipulation, and integration processes.
- Develop solutions using data lakes, data warehouses, and big data technologies.
- Work alongside clients and contribute to the design and delivery of high-quality data engineering solutions.
- Support data modelling, analysis, and profiling activities.
Requirements
- Experience with large-scale data transformation and the design of high-quality data processing pipelines.
- Experience working with enterprise data warehouses and closely integrated systems that provide or consume data.
- Experience with dbt and ETL, plus data engineering or BI/software development in data lake and data warehouse environments.
- Knowledge of big data technologies and cloud data warehouses such as Redshift and Snowflake.
- Experience with SQL, Python, Apache Kafka, Apache Spark, and open-source data tooling.
- Extensive experience with Databricks, Apache Spark, SQL, and data lakes.
- Experience with data modelling, analysis, and profiling is preferred.
Benefits
- Market-leading salaries are offered, but no specific salary amount is stated.
- Training, conference attendance, and ongoing professional development support are provided.
- Employees can contribute to the development and strategic direction of the business.
- Flexible work arrangements include a four-day workweek option.
- The role is with a small team that is part of a global consultancy and supports an inclusive culture.
Tech Stack
Categories
Data Engineering