2 months ago
Athens, GreeceSenior
Responsibilities
- Lead end-to-end integration architecture across feed ingestion, domain modeling, streaming, entity resolution, and UI distribution.
- Design ingestion and entity-resolution systems that map external barge data to reference data using Elasticsearch and PostgreSQL patterns.
- Build scalable Kafka streaming pipelines with event-driven contracts, Avro schemas, deduplication, and dead-letter queue replay mechanisms using Python and Scala.
- Deliver integrated data through Elasticsearch read models, external APIs, data warehouse feeds, and the Kpler Terminal using TypeScript and Vue.
- Own production operations by setting SLOs, maintaining observability, participating in on-call rotations, and driving post-incident improvements.
- Validate external feeds and support human-in-the-loop analyst workflows for correcting barge movements.
- Mentor engineers, document architectural designs, and contribute to decomposing legacy systems into event-driven services.
Requirements
- Approximately 5+ years of experience designing, operating, and maintaining data-intensive production systems with full ownership.
- Advanced Python and SQL expertise, including building well-bounded services in complex and evolving codebases.
- Production experience with Kafka streaming, schema management using Avro and Schema Registry, deduplication, and replay patterns.
- Experience integrating third-party data feeds, mapping schemas, and building data-quality monitoring frameworks.
- Experience with production observability, documentation, and incident resolution in distributed systems.
- Experience or familiarity with Scala or evidence of quickly mastering new programming languages is preferred.
- Familiarity with PostGIS or geospatial data and exposure to maritime, logistics, or commodities domains are preferred.
- Exposure to Elasticsearch, Airflow, Snowflake or lakehouse table formats, Kubernetes, and GitOps deployments is preferred.
- Working knowledge of TypeScript or Vue for collaboration on user-facing terminal features is preferred.
Benefits
- The company emphasizes inclusive, diverse, and supportive working practices.
- Kpler offers opportunities to work with a global team of more than 850 people across 69 countries.
- The posting encourages applicants who do not meet every listed requirement and highlights support for different backgrounds and experiences.
Tech Stack
Categories
BackendData Engineering
About Kpler
Kpler builds a subscription SaaS platform that aggregates and analyzes global commodity flows, energy markets, and vessel movements for traders, analysts, and maritime operators. Founded in 2014 and headquartered in Brussels, the privately held company also operates the MarineTraffic brand, extending its ship-tracking and maritime intelligence coverage across 40+ markets.