Data Engineer (Content Processing)
Centre for Strategic Infocomm Technologies3 months ago
Singapore, SingaporeMid Level
Responsibilities
- Architect, design, and maintain reliable high-throughput pipelines for large-scale unstructured data ingestion and processing.
- Integrate AI models for automated data classification and information extraction while meeting latency and throughput requirements.
- Develop transformation, parsing, chunking, enrichment, and vector-embedding logic for downstream retrieval.
- Build and support hybrid indexing systems combining keyword search with vector-based semantic search.
- Engineer scalable video analysis and image recognition solutions using computer vision models.
- Maintain data quality, pipeline reliability, code quality, testing, and observability standards.
- Collaborate with frontend engineers, data scientists, and product managers to deliver high-performance data services.
Requirements
- Background in Computer Science or a related field with proven hands-on experience in data engineering or software development.
- Experience building scalable ETL/ELT pipelines that process, transform, and validate large datasets.
- Understanding of data quality principles and pipeline reliability patterns.
- Ability to communicate complex technical concepts clearly.
- Familiarity with vector databases, text embeddings, LLM integration, or semantic search frameworks is preferred.
- Familiarity with Docker, Kubernetes, and modern CI/CD practices is preferred.
- Experience with multimedia processing tools or computer vision libraries is preferred.
- Experience handling high-volume unstructured data in cloud-native environments is preferred.
Benefits
- Work directly on technology supporting Singapore’s national security mission.
- Gain hands-on experience with AI solutions and modern cloud-native data technologies at scale.
- Collaborate in a strong engineering culture with a commitment to work-life balance.
- Receive opportunities to innovate and grow at the intersection of data engineering and artificial intelligence.
- Only Singapore Citizens will be considered.
Tech Stack
Categories
Data Engineering
About Centre for Strategic Infocomm Technologies
The Centre for Strategic Infocomm Technologies (CSIT) is a Singapore government agency that develops cybersecurity, data analytics, and software systems to support national security and public-sector operations. It conducts applied research, builds AI and cyber‑defence tools in a self‑managed secure cloud, and delivers enterprise applications for internal users. Established in 2003 and based in Singapore, CSIT is part of the Defence Technology Community.