GrepJob
OKX

Big Data Platform Engineer, AI Agent Platform

OKX
Apply
6 days ago
Singapore, Singapore
Senior

Responsibilities

  • Design and operate large-scale distributed data systems.
  • Own the big data compute and storage infrastructure.
  • Build and maintain multi-site task orchestration.
  • Drive reliability and performance improvements across pipelines.
  • Develop and expose MCP tool interfaces for AI agents.
  • Build scheduling and cost-optimization agents.
  • Instrument platform telemetry for AI-driven monitoring.
  • Design context retrieval pipelines for SQL code and config.
  • Own the internal data development platform.
  • Build APIs-first tools for future MCP integration.
  • Collaborate with teams to define platform contracts.
  • Establish SLA benchmarks and cost metrics.
  • Build automated incident response pipelines.
  • Define and enforce infrastructure policies across multi-cloud.

Requirements

  • 5+ years of experience building large-scale data platforms.
  • Deep expertise in distributed storage and compute systems.
  • Strong software engineering skills in Java, Scala, or Python.
  • Hands-on experience with task scheduling systems.
  • Solid understanding of multi-cloud architectures.
  • Familiarity with LLM integration patterns.
  • Experience with MCP or similar agent-tool frameworks is a plus.
  • Passion for building systems that enhance engineer productivity.

Benefits

  • Competitive total compensation package.
  • L&D programs and education subsidy for employee growth.
  • Various team building programs and company events.
  • Wellness and meal allowances.
  • Comprehensive healthcare schemes for employees and dependants.

Tech Stack

Apache AirflowApache FlinkApache HadoopApache HiveApache SparkClickHouseJavaPythonScala

Categories

AI & MLData Engineering