1 month ago
United Kingdom (city not specified)Senior
Responsibilities
- Design, build, deploy, operate, monitor, and maintain end-to-end production data pipelines and infrastructure.
- Develop and containerize applications in AWS using Python, Docker, Kubernetes, Airflow, and Terraform.
- Architect PostgreSQL database structures and Kafka/Flink event-streaming flows to support data integrity.
- Lead pipeline architecture, peer reviews, technical standards, and logging, monitoring, and alerting frameworks.
- Collaborate with engineers, product managers, and data scientists while mentoring peer engineers.
- Research and implement modern data infrastructure tools and frameworks.
Requirements
- At least 5 years of experience designing, operating, and owning production-grade data pipelines and infrastructure.
- Strong Python skills and hands-on experience with Docker, Kubernetes, AWS, Airflow, and PostgreSQL or similar relational databases.
- Practical experience with Kafka or Flink, Terraform, CI/CD practices, and production logging and monitoring systems.
- Ability to lead architectural discussions, mentor engineers, and use AI-assisted coding tools such as Copilot, Cursor, and Claude with sound technical judgment.
- Experience working in Agile environments and strong written and spoken English communication skills.
- Preferred: experience with large-scale data processing or analytics platforms, cross-team technical initiatives, and commodities, shipping, energy, or marine insurance market data.
Tech Stack
Categories
Data Engineering
About Kpler
Kpler builds a subscription SaaS platform that aggregates and analyzes global commodity flows, energy markets, and vessel movements for traders, analysts, and maritime operators. Founded in 2014 and headquartered in Brussels, the privately held company also operates the MarineTraffic brand, extending its ship-tracking and maritime intelligence coverage across 40+ markets.