Data Engineer
Oversea-Chinese Banking Corporation Limited8 hours ago
Singapore, SingaporeSenior
Responsibilities
- Build, maintain, and improve batch and streaming data pipelines for enterprise data warehouses and lakehouse platforms.
- Develop reusable data models, analytical datasets, reporting foundations, and ingestion pipelines from APIs, GA4, and other sources.
- Create and support batch processing, real-time streaming, CDC, messaging, and orchestration workflows.
- Develop and operate Airflow or Dagster workflows and troubleshoot pipeline issues according to SLAs and monitoring practices.
- Deploy and support data workloads on Cloudera, GCP, and AWS infrastructure, including Docker, Kubernetes, Cloud Run, and Terraform.
- Build REST APIs and backend services using Python and Flask and use Redis caching for performance.
- Support vector database, embedding generation, semantic search, document chunking, and RAG pipelines for AI knowledge bases.
- Collaborate with senior engineers, AI teams, and business stakeholders to translate requirements into technical work and participate in code reviews.
Requirements
- Diploma, bachelor’s, or master’s degree in computer science or a related field.
- At least five years of experience in data engineering, data platforms, or related roles.
- Hands-on experience building data pipelines on data warehouse, lakehouse, batch-processing, and real-time processing architectures.
- Experience with SQL, Spark, ETL, Python or Java, and data ingestion or processing pipelines.
- Familiarity with Flink or other real-time processing engines and exposure to CDC tools such as Debezium, Confluent, or Fivetran.
- Experience with Airflow or Dagster, GCP or AWS, Docker, Kubernetes, Cloud Run, CI/CD pipelines, and Terraform.
- Experience with Python, Flask, REST APIs, and preferably Redis.
- Familiarity with vector databases, embeddings, semantic search, RAG components, LLM or AI-agent use cases, and real-time or low-latency system design is preferred.
- Banking or financial services experience, a product mindset, and strong communication and collaboration skills are preferred.
Benefits
- Competitive base salary and comprehensive, flexible benefits.
- Learning and professional development opportunities.
- Exposure to enterprise-scale data and AI initiatives across the OCBC Group.
- Collaborative environment focused on innovation, craftsmanship, and continuous improvement.
- Community initiatives and wellbeing-focused support.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache KafkaApache SparkAWSdbtDockerFlaskGoogle BigQueryGoogle Cloud PlatformJavaKubernetesPythonRedisSQLTerraform
Categories
Data Engineering
About Oversea-Chinese Banking Corporation Limited
Oversea-Chinese Banking Corporation (OCBC) is a Singapore-headquartered bank founded in 1932 that provides consumer, corporate, investment, and transaction banking, plus wealth and private banking, insurance, asset management, and stockbroking. It serves retail customers, SMEs, and large enterprises across key markets including Singapore, Malaysia, Indonesia, and Greater China. OCBC is publicly listed on the Singapore Exchange and operates subsidiaries such as Bank of Singapore, Great Eastern, Lion Global Investors, OCBC NISP, and OCBC Wing Hang.