Kpler

Senior Data Engineer - Financial Flows

Kpler
Apply
13 days ago
United Kingdom (city not specified)Senior

Responsibilities

  • Design, build, and operate batch and real-time streaming ingestion pipelines using external financial-market APIs and WebSockets.
  • Lead migration of legacy backend infrastructure and production services to AWS and modern cloud-native environments.
  • Rewrite CTA positioning indicator calculations from PHP to Python while preserving mathematical output parity, test coverage, and latency.
  • Ingest and model futures pricing, open interest, and trading-volume data in time-series and search databases.
  • Implement automated data validation, monitoring, alerting, and troubleshooting to maintain accurate and fault-tolerant market-data feeds.
  • Deploy, maintain, and scale containerized services with Docker, Kubernetes, CI/CD pipelines, and GitOps workflows.
  • Collaborate with quantitative researchers, commodity analysts, and product managers to productionize trading models.
  • Mentor engineers through code reviews, system-design guidance, and architectural documentation.

Requirements

  • At least 5 years of professional experience building, operating, and scaling production data pipelines and backend infrastructure.
  • Advanced Python expertise and experience refactoring production-critical code for performance and testability.
  • Hands-on experience building and maintaining real-time or streaming REST and WebSocket ingestion pipelines for time-series data.
  • Production experience deploying and managing containerized applications on AWS using Docker, Kubernetes, and modern CI/CD practices.
  • Strong SQL and database fundamentals, including experience with distributed search or time-series databases such as Elasticsearch, QuestDB, or ClickHouse.
  • Deep experience with automated data-quality frameworks, observability, monitoring, alerting, and root-cause troubleshooting.
  • Financial-market knowledge, including futures contracts, open interest, commodities trading symbology, or related market structures, is preferred.
  • Experience integrating Bloomberg, LSEG, Enverus, or Trading Technologies data is preferred.
  • Familiarity with legacy PHP migration, GitOps frameworks, and infrastructure-as-code tooling is preferred.

Benefits

  • Inclusive and diverse work environment with an equal-opportunity employer commitment.
  • Supportive, collaborative culture focused on mentorship, accessibility, and global teamwork.

Tech Stack

AWSClickHouseDockerElasticsearchKubernetesPHPPythonSQL

Categories

BackendData Engineering
Kpler

About Kpler

501-1,000 employees

Kpler builds a subscription SaaS platform that aggregates and analyzes global commodity flows, energy markets, and vessel movements for traders, analysts, and maritime operators. Founded in 2014 and headquartered in Brussels, the privately held company also operates the MarineTraffic brand, extending its ship-tracking and maritime intelligence coverage across 40+ markets.

Contact me