Principal Data Engineer
Firmus Technologies2 months ago
Singapore, SingaporeStaff+
Responsibilities
- Own Firmus’s company-wide data architecture, technology choices, technical standards, and long-term build-versus-buy, storage, and streaming-versus-batch decisions.
- Build and operate real-time and AI data pipelines, storage layers, transformation layers, and semantic layers for BI, analytics, and customer-facing reporting.
- Deliver and operate streaming and batch ingestion from GPU telemetry, cooling sensors, billing, and incident sources with reliability, schema-evolution, and latency SLAs.
- Deploy data components as infrastructure-as-code on self-hosted, bare-metal Kubernetes and own their quality, deployment, and storage cost.
- Define data contracts, lineage, access control, data quality, observability, freshness SLAs, anomaly detection, and governance standards.
- Extend SOC 2 Type 2 and ISO 27001 controls to the data platform and support regulatory requirements for enterprise and government customers.
- Lead design and architecture reviews, drive the RFC process, identify architectural risks, and mentor data engineers.
- Present architecture decisions to the CTO and engineering leadership and engage customers on architecture, lineage, and compliance.
- Partner with AI and application teams on AI-agent workflows and hardware failure prediction.
- Participate in incident-response on-call rotation for owned services and travel overseas occasionally as required.
Requirements
- Bachelor’s degree in computer science or a related technical field.
- 10+ years of experience in data engineering or data architecture, including at least 5 years making platform-level decisions relied upon by other teams.
- Previous experience as the most senior data engineer or architect in an organization, owning architecture rather than merely contributing to it.
- Deep hands-on knowledge of ingestion, storage patterns, transformation, semantic layer design, observability, and governance.
- Experience designing large-scale data platforms across multiple regions or data centers.
- Production experience operating high-cardinality time-series and telemetry pipelines at high ingest and update rates.
- Production experience with columnar, time-series, relational, object, and vector storage patterns.
- Hands-on experience with high-throughput, low-latency event streaming platforms such as Apache Kafka.
- Experience with managed data platforms such as Databricks or Snowflake and self-hosted open-source equivalents such as Spark, Trino, ClickHouse, Delta Lake, and Apache Iceberg.
- Strong proficiency in Python and SQL and experience with distributed processing frameworks such as Apache Spark.
- Experience with Airflow, dbt, and data quality testing in pipeline development.
- Kubernetes experience including Helm-based deployments and stateful data workloads on self-hosted, bare-metal infrastructure.
- Experience delivering data governance programs against SOC 2 Type 2 or ISO 27001 compliance frameworks.
- Experience running architectural reviews and setting engineering standards across teams.
- Willingness to participate in incident-response on-call and travel overseas occasionally.
- Clear and effective written and verbal communication in English.
- Preferred: experience in AI infrastructure, GPU cloud, high-performance computing, industrial IoT, OT telemetry, vector databases, or embedding and retrieval pipelines for LLM and AI-agent use cases.
Benefits
- Full-time employment based in Singapore.
- Occasional overseas travel may be required.
- Participation in an incident-response on-call rotation is required for owned services.
- Inclusive workplace committed to diversity and equal participation.
Tech Stack
Categories
Data Engineering
About Firmus Technologies
Firmus Technologies builds energy‑efficient AI infrastructure, developing liquid‑cooled “AI Factory” data centers and operating a large‑scale GPU cloud for model training. The company sells capacity and services to developers, enterprises, education, and government customers, with a focus on energy and cost efficiency across Asia‑Pacific. Founded in 2019 in Australia, Firmus is privately held and headquartered in St Leonards, Tasmania.