Data Engineer (AVP)
Oversea-Chinese Banking Corporation Limited2 months ago
Singapore, SingaporeSenior
Responsibilities
- Build and maintain batch and streaming data pipelines for data warehouse and lakehouse platforms.
- Develop reusable data models, analytical datasets, reporting foundations, and batch processing jobs using Spark, SQL, Python, or Java.
- Support real-time streaming pipelines using Flink or similar tools and operate CDC pipelines using tools such as Debezium, Confluent, or Fivetran.
- Create ingestion and messaging integrations from APIs, GA4, Pub/Sub, Kafka, and other data sources.
- Develop and maintain Airflow DAGs for scheduled and event-driven workflows.
- Deploy and support data workloads on Cloudera, GCP, and AWS-equivalent infrastructure, including Docker, Kubernetes, and Cloud Run environments.
- Maintain CI/CD pipelines and use Terraform to provision and manage infrastructure under senior guidance.
- Build and support REST APIs and backend services with Python and Flask, including Redis caching.
- Support vector database pipelines, embedding generation, document chunking, semantic search, retrieval quality, and RAG workflows for AI knowledge bases.
- Collaborate with senior data engineers, AI teams, and business stakeholders; translate requirements into technical tasks and participate in code reviews.
Requirements
- Diploma, bachelor's, or master's degree in computer science or a related field.
- At least 5 years of experience in data engineering, data platforms, or related roles.
- Hands-on experience building data pipelines on data warehouse, lakehouse, batch-processing, and real-time-processing architectures.
- Experience with Python, SQL, data ingestion, and pipeline development.
- Familiarity with cloud infrastructure, orchestration, CI/CD, Terraform, backend services, and data operations.
- Working knowledge of AI knowledge-base concepts such as vector databases, embeddings, and semantic search is preferred.
- Experience with RAG components, LLM or AI-agent data layers, banking or financial services, and real-time or low-latency architectures is preferred.
- Strong communication, collaboration, learning orientation, and product mindset are preferred.
Benefits
- Competitive base salary and comprehensive, flexible benefits.
- Learning and professional development opportunities.
- Exposure to enterprise-scale Data and AI initiatives across the OCBC Group.
- Collaborative environment focused on innovation, craftsmanship, and continuous improvement.
- Community initiatives and support for employee wellbeing and growth.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache KafkaApache SparkAWSDockerFlaskGoogle BigQueryGoogle Cloud PlatformJavaKubernetesPythonRedisSQLTerraform
Categories
Data Engineering
About Oversea-Chinese Banking Corporation Limited
Oversea-Chinese Banking Corporation (OCBC) is a Singapore-headquartered bank founded in 1932 that provides consumer, corporate, investment, and transaction banking, plus wealth and private banking, insurance, asset management, and stockbroking. It serves retail customers, SMEs, and large enterprises across key markets including Singapore, Malaysia, Indonesia, and Greater China. OCBC is publicly listed on the Singapore Exchange and operates subsidiaries such as Bank of Singapore, Great Eastern, Lion Global Investors, OCBC NISP, and OCBC Wing Hang.