Senior Data Engineer
Oversea-Chinese Banking Corporation Limited2 months ago
Singapore, SingaporeSenior
Responsibilities
- Design and build scalable, reliable data pipelines using native services on a major cloud platform.
- Implement lakehouse solutions with Apache Iceberg and open metadata and catalogue frameworks.
- Modernize data processing pipelines using cloud-first architectural principles.
- Develop and maintain real-time streaming pipelines using native streaming, messaging, and event ingestion services.
- Build structured streaming logic with Spark Structured Streaming or equivalent cloud-native tools.
- Migrate complex SQL workloads and legacy processing systems to cloud-native architectures.
- Optimize SQL and transformation logic for scalable cloud compute and storage.
- Build end-to-end ETL/ELT workflows using Python and Unix/Linux shell scripting.
- Develop automated data quality checks, validation processes, and operational monitoring.
- Use catalogue and governance solutions to support lineage, metadata capture, accessibility, and data governance.
- Troubleshoot pipeline issues, improve data reliability, and optimize processing performance.
- Collaborate with analysts, data scientists, stakeholders, and cross-functional teams.
- Design, develop, test, integrate, and troubleshoot software applications; participate in code reviews and improve code quality.
Requirements
- Minimum 3 years of relevant industry experience.
- Degree in Computer Science, Information Technology, or a related field.
- Hands-on experience with Spark, PySpark, Iceberg, streaming systems, and open data catalogue or governance frameworks.
- Proficiency in Python, SQL, and Unix/Linux shell scripting.
- Experience with cloud-native data engineering and major cloud platforms.
- Strong software development fundamentals and proficiency in one or more programming languages such as Java, Python, or C++.
- Experience with Agile development methodologies and version control systems such as Git.
- Strong problem-solving, communication, collaboration, learning agility, and adaptability skills.
- Banking or financial services software development experience is preferred.
Benefits
- Competitive base salary.
- Holistic and flexible benefits.
- Community initiatives.
- Industry-leading learning and professional development opportunities.
- Support for employee wellbeing, growth, and career aspirations.
About Oversea-Chinese Banking Corporation Limited
Oversea-Chinese Banking Corporation (OCBC) is a Singapore-headquartered bank founded in 1932 that provides consumer, corporate, investment, and transaction banking, plus wealth and private banking, insurance, asset management, and stockbroking. It serves retail customers, SMEs, and large enterprises across key markets including Singapore, Malaysia, Indonesia, and Greater China. OCBC is publicly listed on the Singapore Exchange and operates subsidiaries such as Bank of Singapore, Great Eastern, Lion Global Investors, OCBC NISP, and OCBC Wing Hang.