Cloudera Data Engineer
Midis Group2 months ago
Dubai, United Arab EmiratesSenior
Responsibilities
- Design, build, and maintain big data pipelines using Cloudera CDP components.
- Develop and optimize ETL/ELT workflows using Spark, Hive, and Hadoop.
- Manage HDFS storage for high availability and performance.
- Provide production support through issue resolution, monitoring, troubleshooting, and performance tuning.
- Troubleshoot cluster-level resource utilization, scheduling, and configuration issues.
- Collaborate with data scientists, analysts, and engineering teams on data-driven initiatives.
- Support data governance, security, and compliance across big data environments.
- Participate in solution design, architecture discussions, and technical documentation.
Requirements
- Strong hands-on experience with Cloudera CDP and the Hadoop ecosystem.
- Proficiency with HDFS, YARN, MapReduce, Hive, and Impala.
- Strong Apache Spark experience, with PySpark or Scala preferred.
- Solid understanding of distributed systems and big data architecture.
- Experience supporting and troubleshooting production big data environments.
- Strong SQL skills and experience optimizing large-scale queries.
- Familiarity with Linux, shell scripting, and automation tools.
- Experience with Git and CI/CD workflows is a plus.
- Bachelor's degree in Computer Science or a related field.
- Experience with AWS, Azure, or GCP for big data workloads.
- Exposure to Kafka, NiFi, Oozie, or similar data orchestration tools.
- Knowledge of Docker, Kubernetes, or containerized environments.
- Understanding of security, encryption, and data governance concepts.
Tech Stack
Apache HadoopApache HiveApache KafkaApache SparkAWSAzureDockerGitGoogle Cloud PlatformKubernetesLinuxScalaSQLYarn
Categories
Data Engineering
About Midis Group
Midis Group is a privately held IT services, distribution, and systems integration group connecting global technology vendors with customers across Eastern Europe, the Middle East, and Africa. It operates through distribution, retail, system integration, and managed services, delivering software, hardware, cloud, security, data center, and data/AI solutions for enterprises and public-sector clients. The group comprises 175+ companies in 70+ countries and offers professional services such as VMware Cloud Foundation implementations and migrations.