Senior Data Engineer - Terminal.exe

2 months ago

Remote, EMEASenior

Responsibilities

Design and build ELT pipelines that ingest data from terminal operating systems such as Navis N4 into the Azure platform.
Implement near-real-time three-minute microbatch pipelines for operational reporting and daily batch pipelines for analytics.
Develop watermark-based incremental extraction over Kafka-compatible Azure Event Hubs into PostgreSQL staging.
Build and evolve multi-tenant Azure PostgreSQL architecture with database-per-tenant isolation.
Maintain the standardized STG, ODS, and DataMart data layers using the internal declarative transformation framework dewi.
Develop and extend internal connector tooling written in Go.
Implement data quality monitoring for gap detection, freshness alerting, and reconciliation.
Map data across TOS versions and configurations into standardized definitions of moves, calls, and equipment events.
Work directly with terminal operations staff to shape the platform and data model.

5+ years of data engineering experience, including end-to-end ownership of production data platforms.
Strong SQL and Python skills.
Experience with SQL Server as a source system and PostgreSQL as a target store.
Experience building and operating ELT pipelines against operational source systems using watermark-based incremental extraction, CDC, or replica-based extraction.
Experience with event-driven or streaming architectures.
Experience with cloud data platforms on Azure.
Comfort making architectural decisions and owning a product under active development.
Go experience is a significant plus.
Familiarity with AKS, Azure DevOps CI/CD, GitOps, Argo CD, and OpenTelemetry is a plus.
Knowledge of container terminals or port logistics, Navis N4 or another TOS, multi-tenant SaaS data architecture, and declarative YAML-driven transformation frameworks is desirable.

Fully remote within Europe.
€5,000 annual personal growth budget.
25 vacation days, with the option to buy up to 10 additional days.
Local public holidays and the option of a sabbatical of up to four months.
Two annual trips abroad with the team, plus occasional drinks and team outings.
€500 home-office budget and a laptop.
Statutory benefits such as pension, health, social security, leave, sick pay, and notice follow the hire’s country through a local contract or EOR.

51-200 employees