2 months ago
Athens, GreeceSenior
Responsibilities
- Lead the end-to-end integration architecture for external barge data, including ingestion, domain modeling, streaming, entity resolution, and UI distribution.
- Design ingestion and entity-resolution systems that map barge data to vessels, zones, installations, and product reference data.
- Build Kafka streaming pipelines with event-driven contracts, Avro schemas, deduplication, and dead-letter queue replay mechanisms using Python and Scala.
- Deliver integrated data through Elasticsearch read models, external APIs, data warehouse feeds, and the Kpler Terminal using TypeScript and Vue.
- Own production operations by setting SLOs, participating in on-call rotations, improving observability, and driving post-incident improvements.
- Validate external feeds and support analyst workflows so data corrections are applied to barge movements.
- Mentor engineers, document architectural decisions, and help decompose legacy systems into event-driven services.
Requirements
- Approximately 5+ years of experience designing, operating, and maintaining production data-intensive systems with full ownership.
- Advanced Python and SQL skills and the ability to build well-bounded services in complex codebases.
- Production experience with Kafka streaming, including Avro or Schema Registry schema management, deduplication, and replay patterns.
- Experience integrating third-party data feeds, mapping schemas, resolving entities, and building data-quality monitoring frameworks.
- Experience with production observability, documentation, incident resolution, and distributed systems.
- Experience or familiarity with Scala, including Kafka Streams, or demonstrated ability to learn new languages quickly.
- Familiarity with geospatial data tools such as PostGIS or with maritime, logistics, or commodities domains.
- Exposure to Elasticsearch, Airflow, Snowflake or lakehouse table formats, Kubernetes, and GitOps deployments.
- Working knowledge of TypeScript or Vue for collaboration on user-facing terminal features.
Tech Stack
Categories
Data EngineeringFull Stack
About Kpler
Kpler builds a subscription SaaS platform that aggregates and analyzes global commodity flows, energy markets, and vessel movements for traders, analysts, and maritime operators. Founded in 2014 and headquartered in Brussels, the privately held company also operates the MarineTraffic brand, extending its ship-tracking and maritime intelligence coverage across 40+ markets.