Data Engineer (AVP)
Oversea-Chinese Banking Corporation Limited1 month ago
Singapore, SingaporeSenior
Responsibilities
- Build and maintain batch and streaming data pipelines for enterprise data warehouse and lakehouse platforms.
- Develop reusable data models, analytical datasets, reporting foundations, and data ingestion and processing jobs using Spark, SQL, Python, or Java.
- Support real-time streaming and CDC pipelines using tools such as Flink, Debezium, Confluent, Fivetran, Pub/Sub, and Kafka.
- Develop and maintain Airflow DAGs for scheduled and event-driven workflows and troubleshoot pipeline issues against established SLAs and monitoring practices.
- Deploy and support data workloads and infrastructure on Cloudera, GCP, and AWS environments using Docker, Kubernetes, Cloud Run, and Terraform.
- Build and support Python/Flask backend services and REST APIs, including Redis caching for performance.
- Assist with vector database pipelines, embedding generation, document chunking, semantic search, retrieval quality, AI knowledge bases, and RAG pipelines.
- Collaborate with senior data engineers, AI teams, and business stakeholders to translate requirements into technical implementation tasks and participate in code reviews.
Requirements
- Diploma, bachelor's, or master's degree in computer science or a related field.
- At least 5 years of experience in data engineering, data platforms, or related roles.
- Hands-on experience building data pipelines on data warehouse, lakehouse, batch-processing, and real-time processing architectures.
- Experience with modern data engineering technologies including Python, SQL, Spark, cloud platforms, orchestration, and data ingestion pipelines.
- Working knowledge of vector databases, embeddings, semantic search, document chunking, retrieval, RAG pipelines, and data layers supporting LLM or AI-agent use cases is preferred.
- Experience with banking or financial services is preferred.
- Familiarity with Flink, CDC tools, Docker/Kubernetes/Cloud Run, CI/CD pipelines, Terraform, Flask, REST APIs, and Redis is preferred.
- Strong communication, collaboration, learning, and data-product mindset are expected.
Benefits
- Competitive base salary and comprehensive, holistic, flexible benefits.
- Learning and professional development opportunities.
- Exposure to enterprise-scale Data and AI initiatives across the OCBC Group.
- Collaborative environment focused on innovation, craftsmanship, and continuous improvement.
- Community initiatives and support for employee wellbeing, growth, and aspirations.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache KafkaApache SparkAWSDockerFlaskGoogle BigQueryGoogle Cloud PlatformJavaKubernetesPythonRedisSQLTerraform
Categories
Data Engineering
About Oversea-Chinese Banking Corporation Limited
Oversea-Chinese Banking Corporation (OCBC) is a Singapore-headquartered bank founded in 1932 that provides consumer, corporate, investment, and transaction banking, plus wealth and private banking, insurance, asset management, and stockbroking. It serves retail customers, SMEs, and large enterprises across key markets including Singapore, Malaysia, Indonesia, and Greater China. OCBC is publicly listed on the Singapore Exchange and operates subsidiaries such as Bank of Singapore, Great Eastern, Lion Global Investors, OCBC NISP, and OCBC Wing Hang.