Senior Data Engineer
Oversea-Chinese Banking Corporation Limited2 months ago
Singapore, SingaporeSenior
Responsibilities
- Design and build scalable, reliable cloud-native data pipelines.
- Implement data lakehouse solutions using Apache Iceberg and open metadata and catalogue frameworks.
- Develop and maintain real-time streaming pipelines and structured streaming logic using Spark or equivalent cloud-native tools.
- Migrate complex SQL workloads and legacy processing systems to cloud-native architectures.
- Build end-to-end ETL/ELT workflows using Python and Unix/Linux shell scripting.
- Write efficient SQL for complex data transformations and analytics.
- Develop automated data quality checks, validation processes, and operational monitoring.
- Support data governance, lineage, metadata capture, and data accessibility across domains and teams.
- Troubleshoot pipeline issues, optimize processing performance, and ensure data reliability.
- Collaborate with analysts, data scientists, business stakeholders, and cross-functional teams.
- Participate in software development, testing, code reviews, integration, and technical issue resolution.
Requirements
- At least 3 years of relevant industry or software development experience.
- Degree in Computer Science, Information Technology, or a related field.
- Hands-on experience with Spark, PySpark, Apache Iceberg, streaming systems, and open data catalogue or governance frameworks.
- Proficiency in Python, SQL, and Unix/Linux shell scripting.
- Experience with open catalogue or governance solutions such as Open Data Catalogue, OpenMetadata, or DataHub.
- Proficiency in one or more programming languages such as Java, Python, or C++.
- Experience with version control systems such as Git.
- Strong software development fundamentals, problem-solving ability, learning agility, communication, and collaboration skills.
- Banking or financial services experience is preferred.
Benefits
- Competitive base salary.
- Holistic and flexible benefits to suit different lifestyles.
- Community initiatives.
- Industry-leading learning and professional development opportunities.
- Support for employee wellbeing, growth, and career aspirations.
About Oversea-Chinese Banking Corporation Limited
Oversea-Chinese Banking Corporation (OCBC) is a Singapore-headquartered bank founded in 1932 that provides consumer, corporate, investment, and transaction banking, plus wealth and private banking, insurance, asset management, and stockbroking. It serves retail customers, SMEs, and large enterprises across key markets including Singapore, Malaysia, Indonesia, and Greater China. OCBC is publicly listed on the Singapore Exchange and operates subsidiaries such as Bank of Singapore, Great Eastern, Lion Global Investors, OCBC NISP, and OCBC Wing Hang.