
Platform and Data Engineer
Ensign InfoSecurity5 months ago
Singapore, SingaporeMid Level
Responsibilities
- Develop and deploy data solutions aligned with business, partner, and customer requirements.
- Design, develop, test, deploy, and maintain operational data transformation processes.
- Design, develop, and manage data lake, data warehouse, and relational database architectures.
- Provide monitoring, maintenance, and support for data operations and client projects.
- Manage development, staging, and production environments for system functionality, health, scalability, resiliency, and security.
- Implement and maintain complex AI analytics projects involving large datasets and multiple platforms.
- Produce detailed documentation and ensure quality throughout the project lifecycle.
- Handle multiple customer projects concurrently.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, or equivalent.
- Experience programming with Spark, Python, Go, and Bash for data engineering.
- Understanding of Git and GitLab.
- Familiarity with Docker, Kubernetes, AWS, network concepts, and Linux.
- Aptitude for automation and software profiling.
- At least three years of experience developing data engineering pipelines preferred.
- Knowledge of Kafka, MongoDB, Postgres, Elasticsearch, Lambda, and Glue preferred.
- Strong knowledge of DevSecOps for designing, developing, testing, and deploying customer applications preferred.
- Experience in cybersecurity or the telecommunications industry is advantageous.
- Knowledge of Agile and CI/CD is desirable.
- Familiarity with Proxmox, VMware, KVM, the Hadoop ecosystem, and MPP databases preferred.
- Ability to demonstrate programming skills without being overly dependent on AI.
- Detail-oriented, solution-focused, and able to solve problems.
Benefits
- Singaporeans only, as the candidate may potentially be subjected to clearance depending on projects.
Tech Stack
Apache HadoopApache KafkaApache SparkAWSBashDockerElasticsearchGitGoKubernetesLinuxMongoDBPostgreSQLPython
Categories
BackendData Engineering