Databricks Data Engineer

10 months ago

Brussels, BelgiumSenior

Responsibilities

Design and build Lakehouse data platforms and medallion architectures on Databricks.
Develop batch and streaming pipelines using PySpark and Spark SQL, orchestrated through Databricks Workflows and Jobs.
Ingest, transform, test, deduplicate, and govern data from APIs, files, databases, and SaaS sources.
Create analytical data models, data marts, semantic models, and curated datasets for BI and data science.
Implement cataloguing, lineage, role-based access control, sensitive-data masking, and other governance practices.
Set up CI/CD and deployment pipelines for Databricks assets using Azure DevOps and GitHub-based tooling.
Monitor, troubleshoot, and optimize data pipelines and clusters for performance, robustness, and cost efficiency.
Collaborate with data scientists, analytics engineers, BI developers, cloud engineers, stakeholders, and customers.
Contribute to proposals, pre-sales activities, internal knowledge sharing, coding standards, reusable components, and colleague mentoring.

At least 5 years of experience with Databricks and the Apache Spark ecosystem, preferably Azure Databricks.
Strong programming skills in Python and PySpark and very good SQL skills.
Experience with data modeling, including star schema and dimensional modeling; data vault or 3NF knowledge is a plus.
Hands-on experience building data warehouses, data marts, or analytical data stores for reporting and analytics.
Experience with Azure Data Lake, Azure Data Factory, or similar ingestion and orchestration tools.
Familiarity with CI/CD using Azure DevOps or GitHub Actions and infrastructure as code using Terraform or similar tools.
Understanding of cloud data governance, security, compliance, RBAC, PII handling, and auditing.
Knowledge of analytics and machine learning concepts and preparing data for data science teams is a plus.
Fluent English plus fluency in French and/or Dutch, with strong stakeholder communication and collaboration skills.
Current residency and work authorization in Belgium are required; relocation from other continents cannot be accommodated.

Hybrid working across client sites, the office, and home.
Personal development plan, training budget, and support for Databricks and Azure certifications.
Opportunities to grow toward Lead Data Engineer, Architect, Analytics Engineer, or MLOps Engineer roles.
Access to more than 400 training courses and a digital learning platform.
Brussels office near Brussels North Train Station with food facilities, a gym, padel courts, and a skate park.
Competitive salary, company car with mobility budget, charging card, net allowance, meal vouchers, insurance, and 32 days of annual leave.
Opportunity to help build adesso Belgium’s Data & AI practice with support from the international adesso group.

11-50 employees