13 days ago
Melbourne, AustraliaStaff+
Responsibilities
- Translate client business requirements into technical data solutions and provide technical guidance.
- Design, build, and maintain data pipelines for ingesting, transforming, and delivering data from multiple sources and APIs.
- Develop data solutions using Databricks, Snowflake, or Microsoft Fabric.
- Contribute to data architecture, storage, integration, data modeling, ontologies, and semantic layers.
- Implement pipeline orchestration, scheduling, monitoring, operational support, and performance optimization.
- Apply data quality controls, automated testing, validation, role-based access control, and security best practices.
- Use Git, repository management, CI/CD workflows, and automated deployment practices for data solutions.
- Create data visualizations and reports for business users.
- Document solutions, review code, share knowledge, and improve engineering practices.
Requirements
- Hands-on experience delivering production data solutions with Databricks, Snowflake, or Microsoft Fabric.
- Strong programming skills in Python and SQL.
- Experience designing, developing, and operating data pipelines, including ETL/ELT, orchestration, and monitoring.
- Understanding of data architecture, analytical modeling, dimensional modeling, ontologies, and semantic modeling.
- Experience optimizing data processing and troubleshooting pipeline, query, and platform performance.
- Experience integrating data through APIs, including authentication, error handling, and reliable data exchange.
- Experience with role-based access control and data security best practices.
- Experience using Git, maintaining repositories, writing automated tests, and building CI/CD workflows.
- Experience developing data visualizations and reports.
- Ability to communicate technical choices, collaborate with business and technical stakeholders, and guide other engineers.
- Additional experience with PostgreSQL, SQL Server, Google BigQuery, Amazon Redshift, R, Microsoft Azure, AWS, or Google Cloud is useful.
- Relevant Databricks, Snowflake, or Microsoft Fabric certifications are useful.
Benefits
- Flexible hybrid working with 20 work-from-anywhere days per year.
- Global career pathways and opportunities to move across domains, disciplines, or geographies.
- Continuous learning through certifications, internal academies, technical communities, and funded conferences.
- Well-being and lifestyle allowance, loyalty leave, inclusive parental leave, and employee assistance programs.
- Monthly lifestyle allowance supporting health and wellbeing activities.
- Novated leasing for new and used vehicles.
- Additional loyalty leave on work anniversaries.
- Inclusive parental leave of 12 weeks for primary carers and 4 weeks for secondary carers.
Tech Stack
Categories
Data Engineering
About Endava
Endava is a London-headquartered IT services company that designs, builds, and runs digital platforms for enterprises across payments, banking, insurance, retail, telecoms, and media. It provides consulting, agile software development, testing, cloud, and managed services on a project and outsourcing basis. Founded in 2000, Endava is a public company listed on the NYSE and operates across Europe, the Americas, and Asia.