Data Engineer
Midis Group3 months ago
Beirut, LebanonEntry Level / Mid Level
Responsibilities
- Design and build data pipelines for large and complex datasets, including ingestion, cleansing, validation, and transformation.
- Work with Hadoop, HDFS, Spark, Spark SQL, Hive, Impala, Talend, and CFM.
- Implement data lakes, data warehouses, and NoSQL databases to support analytics and machine learning.
- Optimize, troubleshoot, debug, and monitor data pipeline performance and health.
- Collaborate with Data Scientists and stakeholders to define data requirements and pipeline designs.
- Maintain documentation for pipelines, data models, and data dictionaries.
- Implement data validation, cleansing, security, and compliance measures.
- Research technologies to improve pipeline performance and scalability.
- Provide performance optimization techniques and technical guidance to Application Developers.
- Advise on the design and implementation of large, scalable distributed systems.
- Coordinate regularly with multiple stakeholders and provide user training.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, or a related field.
- At least 1 to 3 years of relevant experience.
- Experience with Python, SQL, Java, Scala, Informatica, Hadoop, Spark, and Hive.
- Ability to design and implement scalable data pipelines and distributed systems.
- Knowledge of data quality, data security, and relevant compliance requirements.
Tech Stack
Categories
Data Engineering
About Midis Group
Midis Group is a privately held IT services, distribution, and systems integration group connecting global technology vendors with customers across Eastern Europe, the Middle East, and Africa. It operates through distribution, retail, system integration, and managed services, delivering software, hardware, cloud, security, data center, and data/AI solutions for enterprises and public-sector clients. The group comprises 175+ companies in 70+ countries and offers professional services such as VMware Cloud Foundation implementations and migrations.