1 month ago
Athens, GreeceSenior
Responsibilities
- Design, build, deploy, operate, monitor, and maintain production-grade data pipelines and infrastructure.
- Develop and containerize applications in AWS using Python, Docker, Kubernetes, Airflow, and Terraform.
- Design PostgreSQL database structures and Kafka/Flink event-streaming flows to support data integrity and reliable data processing.
- Lead complex pipeline design, peer reviews, and logging, monitoring, and alerting standards.
- Collaborate with engineers, product managers, and data scientists while mentoring peer engineers.
- Research and implement improvements to data infrastructure, tools, and frameworks.
Requirements
- At least 5 years of experience designing, operating, and owning production-grade data pipelines and infrastructure.
- Strong Python skills and hands-on experience with Docker, Kubernetes, AWS, Airflow, and relational databases such as PostgreSQL.
- Practical experience with Kafka or Flink, Terraform, CI/CD practices, and production logging and monitoring systems.
- Ability to lead architectural discussions, mentor engineers, and use AI-assisted coding tools such as Copilot, Cursor, and Claude with sound technical judgment.
- Experience working in Agile environments and strong written and spoken English communication skills.
- Preferred qualifications include experience with large-scale data processing or analytics platforms, cross-team technical initiatives, and commodities, shipping, energy, or marine insurance market data.
Tech Stack
Categories
Data Engineering
About Kpler
Kpler builds a subscription SaaS platform that aggregates and analyzes global commodity flows, energy markets, and vessel movements for traders, analysts, and maritime operators. Founded in 2014 and headquartered in Brussels, the privately held company also operates the MarineTraffic brand, extending its ship-tracking and maritime intelligence coverage across 40+ markets.