ASSYSTEM

Data Engineer - Databricks

ASSYSTEM
Apply
2 months ago
Bristol, United KingdomMid Level

Responsibilities

  • Design, develop, maintain, test, document, and deploy data products using Databricks and Azure technologies.
  • Build scalable ETL/ELT pipelines to ingest, transform, and load data from multiple enterprise systems.
  • Develop transformations using PySpark, Spark SQL, SQL, and Python, and create curated datasets for reporting and analytics.
  • Implement data quality, reconciliation, validation, monitoring, documentation, and data lineage processes.
  • Optimise pipelines and workloads for performance, reliability, and cost efficiency.
  • Support production data products, resolve data quality or availability issues, and participate in release, deployment, and change management activities.
  • Translate business requirements into technical solutions and collaborate with Data Architects, Performance Analysts, and business stakeholders.
  • Contribute to reusable engineering frameworks, technical standards, continuous improvement, and Information Design Authority governance.

Requirements

  • At least 2 years of experience delivering data engineering or business intelligence solutions.
  • Strong commercial experience with Databricks and ETL/ELT pipeline and data integration development.
  • Experience with Apache Spark, PySpark, Spark SQL, SQL development and optimisation, and large complex datasets.
  • Knowledge of data modelling, analytical data structures, data quality and reconciliation processes, semantic models, reporting datasets, and business intelligence concepts.
  • Experience with Power BI and data visualisation, including supporting analysts with reporting and insights.
  • Degree or equivalent qualification in Computer Science, Data Engineering, Information Systems, Mathematics, Engineering, or a related discipline.
  • Databricks, Azure, or Power BI certifications are desirable.
  • Experience in construction, infrastructure, engineering, utilities, energy, or regulated industries is desirable.
  • Familiarity with Integrated Management System governance, advanced Power BI features, dashboard development, and automation using VBA or Python is desirable.

Benefits

  • Hybrid working with flexibility to work from home and the office.
  • 25 days of annual leave plus bank holidays, with the option to buy and sell holiday.
  • 8% company pension contributions.
  • Income protection and three-times-salary death-in-service cover.
  • Competitive sick pay and a healthcare cash plan covering dental and optical costs.
  • Free digital gym access, exclusive discounts, 24/7 employee support, cycle-to-work scheme, flu jabs, and eye-test vouchers.
  • Paid professional membership fees and volunteer days.

Tech Stack

Apache SparkAzureDatabricksMicrosoft SQL ServerPythonSQL

Categories

Data Engineering
ASSYSTEM

About ASSYSTEM

5,001-10,000 employees

Assystem is a public engineering and consulting group headquartered in Courbevoie, France, that designs, supervises, and digitizes complex infrastructure projects for nuclear and low‑carbon energy, grids, hydrogen, and transport clients. It sells engineering, project management, and digital services to utilities, developers, and industrial operators. Founded in 1966 and listed on Euronext Paris, the company operates across Europe, Asia, Africa, and the Middle East.

Contact me