29 days ago
Germany (city not specified)Senior
Responsibilities
- Architect, build, and operate high-throughput batch and streaming data pipelines.
- Design, tune, and maintain scalable distributed NoSQL databases, especially Apache HBase, for high-volume time-series maritime telemetry.
- Operate containerized cloud environments on AWS using Kubernetes, Docker, and Terraform.
- Define reliability metrics and monitor pipeline latency, data completeness, and uptime against operational SLAs.
- Partner with Data Scientists, Product Managers, and SRE teams to deliver production-grade infrastructure.
- Mentor peer engineers, drive code review standards, and use AI-assisted development tools to improve productivity.
Requirements
- At least 5 years of professional experience as a Data Engineer designing, scaling, and maintaining production-grade data pipelines.
- Deep hands-on expertise with distributed NoSQL data stores, specifically Apache HBase, including performance tuning and query optimization.
- Strong Java and Python software engineering proficiency.
- Experience with Apache Kafka, Apache Flink, and Apache Airflow for stream processing and orchestration.
- Experience operating containerized services on AWS using Docker, Kubernetes, and Terraform.
- Experience with PostgreSQL, geospatial technologies such as GeoServer, or spatial indexing algorithms is a plus.
- Exposure to Copilot, Cursor, or Claude Code and familiarity with maritime tracking, AIS telemetry, or supply chain logistics are desirable.
Benefits
- The company offers an inclusive and diverse work environment and welcomes candidates with varied backgrounds and experiences.
Tech Stack
Categories
Data Engineering
About Kpler
Kpler builds a subscription SaaS platform that aggregates and analyzes global commodity flows, energy markets, and vessel movements for traders, analysts, and maritime operators. Founded in 2014 and headquartered in Brussels, the privately held company also operates the MarineTraffic brand, extending its ship-tracking and maritime intelligence coverage across 40+ markets.