20 days ago
Singapore, SingaporeSenior
Responsibilities
- Design, build, and operate end-to-end data pipelines for ingestion, transformation, and serving on Databricks and/or Snowflake.
- Configure and administer workspaces and accounts, including compute policies, resource sizing, environment setup, access hierarchy, and cost management.
- Implement data governance controls including catalog and schema design, RBAC, row- and column-level security, data masking, and lineage tracking.
- Set up CI/CD and infrastructure-as-code for pipeline deployment and promotion across development, test, and production environments.
- Configure monitoring, telemetry, and audit logging for observability and security requirements.
- Support UAT, integration testing, parallel-run validation, migration, and go-live activities.
- Produce runbooks, access lists, escalation procedures, and other handover documentation for operations teams.
Requirements
- Minimum 5 years of hands-on experience in data engineering, data platform engineering, or related disciplines.
- Minimum 3 years of hands-on Databricks experience covering pipeline development, platform administration, governance, and optimization.
- Hands-on experience with Unity Catalog, Lakeflow or Delta Live Tables, Delta Lake, Databricks SQL, cluster and workspace administration, Databricks Asset Bundles, Databricks Repos, PySpark, Spark SQL, and Databricks system tables.
- Strong SQL and Python skills for data engineering.
- Experience with data modeling, including dimensional design, star and snowflake schemas, and semantic layers.
- Experience with CI/CD pipelines and infrastructure-as-code, with Terraform preferred.
- Hands-on experience with at least one hyperscaler: AWS, Azure, or Google Cloud.
- Understanding of data security and compliance frameworks applicable to government and public-sector environments.
- Databricks Certified Data Engineer Associate or Professional certification is preferred.
- SnowPro Core or SnowPro Advanced: Data Engineer certification is preferred.
- AWS certification and hands-on experience with AWS data services are preferred.
- Government or regulated-sector data platform experience, IM8 exposure, and System Integrator delivery experience are preferred.
Tech Stack
Categories
Data Engineering
About Cognizant
Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.