Data Engineer
New Era Technology2 months ago
Kuala Lumpur, MalaysiaSenior
Responsibilities
- Design, develop, maintain, and optimize scalable, secure AWS data platforms and data pipelines for analytics, reporting, and regulatory requirements.
- Build and support ETL/ELT processes that ingest, transform, and deliver data to enterprise Data Lake and Data Warehouse environments.
- Develop batch and near-real-time processing solutions and maintain Apache Iceberg datasets.
- Implement Infrastructure as Code, automated provisioning, deployment processes, monitoring, alerting, and operational support using Terraform and AWS services.
- Plan, execute, document, and validate disaster recovery drills, failover, failback, and recovery procedures for critical data platforms.
- Establish data quality, reconciliation, monitoring, governance, metadata management, data ownership, and discoverability controls.
- Troubleshoot ingestion and platform issues, conduct root cause analysis, and improve performance, scalability, reliability, security, and cost efficiency.
- Collaborate with analysts, BI developers, architects, product owners, and business stakeholders to translate requirements into technical designs and data models.
- Create technical specifications, solution designs, data flow diagrams, runbooks, support guides, and operational procedures.
- Provide technical guidance, conduct knowledge-transfer sessions, mentor junior engineers, and promote engineering standards and best practices.
Requirements
- Bachelor’s degree in computer science, information technology, data engineering, engineering, information systems, or a related discipline.
- At least 3 years of experience in data engineering, data warehousing, data platform engineering, or related roles.
- Hands-on experience with SQL, Python, PySpark, and Terraform.
- Strong experience with AWS Glue, Amazon Redshift, Amazon S3, Amazon RDS, Amazon SNS, AWS Step Functions, Amazon CloudWatch, AWS IAM, Amazon EventBridge, and AWS DataZone.
- Experience designing and supporting enterprise Data Lake and Data Warehouse solutions, Apache Iceberg tables, and large-scale data processing platforms.
- Strong understanding of ETL/ELT, data modeling, data integration, cloud security, IAM permissions, and access control.
- Experience planning and supporting disaster recovery, failover testing, recovery validation, and business continuity activities.
- Knowledge of Agentic AI, Generative AI, AI-assisted software development, and AI-powered coding assistants.
- Strong analytical, troubleshooting, problem-solving, communication, independent-work, and collaboration skills.
- Preferred qualifications include AWS certifications, Power BI experience, SAP BusinessObjects knowledge, AWS DataZone and data governance experience, Data Lakehouse architecture experience, DevOps and cloud automation familiarity, and insurance or financial services experience.
Benefits
- Full-time permanent employment based at the client location in Kuala Lumpur, Malaysia, with an onsite work arrangement.
- Access to continuous training, industry-certified experts, and personal and professional development opportunities.
- Competitive benefits are provided, though specific benefits are not listed.
- Malaysians or Malaysian permanent residents are preferred, and candidates able to join immediately or with up to 30 days’ notice are preferred.
About New Era Technology
New Era Technology provides managed IT and communications services—collaboration/UC, data networking, cloud (CloudBlu), cybersecurity (SecureBlu), physical security, and ongoing managed/professional services—for enterprises, healthcare, education, finance, and government. The privately held company, headquartered in West Chester, PA, operates across the Americas, EMEA, and APAC and implements multi-vendor solutions as a Cisco, Avaya, Palo Alto, Fortinet, Crestron, and Polycom partner.