13 days ago
Sydney, AustraliaStaff+
Responsibilities
- Design, build and maintain data pipelines for ingesting, transforming and delivering data from varied sources, including APIs.
- Develop data solutions using Databricks, Snowflake or Microsoft Fabric based on client requirements and existing environments.
- Contribute to data architecture, storage, integration, analytical modelling, dimensional modelling and semantic-layer design.
- Create data models and ontologies that establish consistent business definitions for analytics and reporting.
- Implement pipeline orchestration, scheduling, monitoring and operational support for reliable data services.
- Troubleshoot and optimise pipeline, query and platform performance, scalability and cost efficiency.
- Apply data quality controls, automated testing, validation, role-based access control and data-security practices.
- Use Git, repository management, CI/CD workflows and automated deployment practices for data solutions.
- Build data visualisations and reports for business users.
- Document solutions, review code, share knowledge and guide other engineers while working with clients and stakeholders.
Requirements
- Production experience delivering data solutions with Databricks, Snowflake or Microsoft Fabric.
- Strong programming skills in Python and SQL.
- Experience designing, developing and operating data pipelines, including ETL/ELT, orchestration and monitoring.
- Understanding of data architecture, analytical modelling, dimensional modelling, ontologies and semantic modelling.
- Experience optimising data processing and troubleshooting pipeline, query and platform performance.
- Experience integrating data through APIs, including authentication, error handling and reliable data exchange.
- Experience with role-based access control and data-security best practices.
- Experience using Git, maintaining repositories, writing automated tests and building CI/CD workflows.
- Experience developing data visualisations and reports.
- Ability to explain technical choices, collaborate with business and technical stakeholders and guide other engineers.
- Useful additional experience includes PostgreSQL, SQL Server, Google BigQuery, Amazon Redshift, R, Microsoft Azure, AWS or Google Cloud.
- Relevant Databricks, Snowflake or Microsoft Fabric certifications are useful.
Benefits
- Flexible hybrid working with 20 work-from-anywhere days per year.
- Global career pathways and opportunities to move between domains, disciplines or geographies.
- Continuous learning through certifications, internal academies, technology communities and funded conferences.
- Monthly lifestyle allowance, loyalty leave, inclusive parental leave and employee assistance programmes.
- Novated leasing benefit for new and used cars.
- Inclusive parental leave of 12 weeks for primary carers and 4 weeks for secondary carers.
- Inclusive, respectful workplace with recruitment adjustments and support available when needed.
Tech Stack
Categories
Data Engineering
About Endava
Endava is a London-headquartered IT services company that designs, builds, and runs digital platforms for enterprises across payments, banking, insurance, retail, telecoms, and media. It provides consulting, agile software development, testing, cloud, and managed services on a project and outsourcing basis. Founded in 2000, Endava is a public company listed on the NYSE and operates across Europe, the Americas, and Asia.