Data Engineer (Mgr)
Oversea-Chinese Banking Corporation Limited21 hours ago
Singapore, SingaporeStaff+
Responsibilities
- Develop and support batch and streaming data pipelines for data lake and data warehouse platforms such as Cloudera, AWS Redshift, and Snowflake.
- Implement reusable data models, monitor pipeline SLAs, and troubleshoot data quality and processing issues.
- Develop batch processing jobs using Spark, SQL, Python, or Java and assist with real-time pipelines using Flink.
- Build ingestion pipelines from APIs, GA4, files, and other data sources, including integrations using Pub/Sub or Kafka.
- Develop and support Airflow DAGs and scheduled or event-driven workflows.
- Support data workloads on Cloudera and AWS, including Docker, Kubernetes, and Cloud Run environments.
- Develop simple REST APIs and backend services with Python and Flask and support Redis caching where required.
- Assist with vector database pipelines, embedding generation, document processing, chunking, semantic search, and RAG workflows.
- Collaborate with senior engineers, AI teams, and business stakeholders, and participate in reviews, testing, documentation, and continuous improvement.
Requirements
- Bachelor’s degree in computer science, information systems, engineering, or a related field.
- At least 2 years of relevant experience in data engineering, data platforms, software engineering, or related roles.
- Hands-on experience building or supporting data pipelines with SQL and Python in a data warehouse, data lake, or cloud environment.
- Basic knowledge of AI knowledge bases, vector databases, embeddings, or semantic search is preferred.
- Exposure to RAG, document chunking, embedding generation, retrieval, LLM or AI-agent data layers, and banking or financial services is preferred.
- Experience with or exposure to Cloudera, Redshift, Spark, ETL, MapReduce, Flink, Airflow, GCP, AWS, Docker, Cloud Run, Python, Flask, and REST APIs is preferred.
- Willingness to learn data engineering, real-time streaming, cloud, low-latency system design, and AI-enabled data engineering.
Benefits
- Competitive base salary.
- Holistic and flexible benefits to suit different lifestyles.
- Community initiatives.
- Learning and professional development opportunities.
- Wellbeing, growth, and career support.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache KafkaApache SparkAWSDockerFlaskGoogle Cloud PlatformJavaKubernetesPythonRedisSnowflakeSQL
Categories
Data Engineering
About Oversea-Chinese Banking Corporation Limited
Oversea-Chinese Banking Corporation (OCBC) is a Singapore-headquartered bank founded in 1932 that provides consumer, corporate, investment, and transaction banking, plus wealth and private banking, insurance, asset management, and stockbroking. It serves retail customers, SMEs, and large enterprises across key markets including Singapore, Malaysia, Indonesia, and Greater China. OCBC is publicly listed on the Singapore Exchange and operates subsidiaries such as Bank of Singapore, Great Eastern, Lion Global Investors, OCBC NISP, and OCBC Wing Hang.