Sign InSign Up
Hong Kong Exchanges and Clearing Limited
Apply
19 hours ago
London, United KingdomStaff+

Responsibilities

  • Shape and deliver a scalable, resilient strategic data platform for high-volume trading and analytical workloads.
  • Build distributed data platforms processing billions of events per day and managing terabyte-scale datasets.
  • Develop data lakehouse capabilities using S3-compatible object storage, Apache Iceberg, Spark, and Trino.
  • Build real-time streaming integrations with Apache Kafka and Apache Flink for low-latency event processing and distribution.
  • Create self-service platform capabilities including APIs, data products, metadata services, and developer enablement frameworks.
  • Drive performance, scalability, reliability, latency, and operational improvements across data ingestion, storage, streaming, querying, and analytics.
  • Implement cloud-native platform engineering practices using Kubernetes/OpenShift, Terraform, CI/CD, GitOps, and infrastructure as code.
  • Lead metadata, lineage, and data discovery capabilities using DataHub, OpenMetadata, or Apache Atlas.
  • Ensure fine-grained access controls, encryption, secrets management, auditing, security, and regulatory compliance.
  • Influence technology strategy and roadmaps across Trading Technology, Data Engineering, and Platform Engineering.

Requirements

  • 10+ years of software development experience in an IT organization, with a strong hands-on software development background.
  • Strong experience with JVM-based languages, preferably Java, Scala, or Kotlin.
  • Expertise developing highly scalable data platforms, data warehouses, modern data lakes, and large-scale distributed systems.
  • Experience with SQL Server, Postgres, S3-compatible object storage, Apache Iceberg, Spark, Trino, Apache Kafka, and Apache Flink.
  • Experience with Kubernetes or OpenShift, Terraform, Docker, cloud-native platform engineering, and infrastructure as code.
  • Experience with metadata, lineage, and data discovery technologies such as DataHub, OpenMetadata, or Apache Atlas.
  • Ability to address platform security, encryption, secrets management, auditing, and regulatory compliance.
  • Bonus experience with Puppet, Chef, Ansible, Bamboo, Confluent-certified Kafka development, and Dollar Universe.
  • Knowledge and understanding of financial markets is a bonus.
  • Strong analytical, communication, leadership, prioritization, judgment, and stakeholder-management skills.

Benefits

  • Permanent position based in London, United Kingdom.
  • Standard 40-hour work week with 40 scheduled weekly hours.
  • Corporate Grade C, Vice President.

Tech Stack

AnsibleApache FlinkApache KafkaApache SparkBambooChefDockerJavaKotlinKubernetesMicrosoft SQL ServerOpenShiftPostgreSQLPuppetScalaTerraform

Categories

Data EngineeringDevOps
Contact me