Senior Data Engineer – AWS
NorthBay Solutions2 months ago
Cairo, EgyptSenior
Responsibilities
- Develop and maintain batch and real-time data pipelines on AWS.
- Implement ETL/ELT solutions using AWS Glue, Spark on EMR, and other AWS services.
- Assist with workflow orchestration using Apache Airflow through MWAA.
- Support serverless data processing using AWS Lambda.
- Participate in designing data warehousing solutions with Amazon Redshift.
- Design and manage data storage strategies using Amazon S3 and DynamoDB.
- Apply data governance and access controls using AWS DataZone.
- Monitor and troubleshoot data platform issues using Amazon CloudWatch.
- Collaborate with Analytics, BI, Data Science, and Business teams.
- Write clean, efficient code and perform peer code reviews.
- Follow security, compliance, and data governance standards.
Requirements
- 5–7 years of experience in Data Engineering or related roles.
- At least 3 years of hands-on experience designing data solutions on AWS.
- Proficiency with AWS Glue, Amazon EMR with Spark, AWS Lambda, Apache Airflow with MWAA, Amazon EC2, Amazon CloudWatch, Amazon Redshift, Amazon DynamoDB, AWS DataZone, and Amazon S3.
- Strong programming skills in Python.
- Advanced SQL skills with performance tuning expertise.
- Understanding of data warehousing, Star and Snowflake data modeling, and ETL/ELT best practices.
- Familiarity with Agile/Scrum delivery environments.
- Strong problem-solving and analytical skills.
- AWS Professional Certification, such as Solutions Architect or Data Analytics Specialty, is preferred.
- Experience with real-time streaming using Kinesis or Kafka is preferred.
- Exposure to data governance and metadata management tools is preferred.
- Knowledge of AWS cost optimization is preferred.
Benefits
- Full-time employment.
- Onsite position in Cairo, Egypt.
Tech Stack
Categories
Data Engineering
About NorthBay Solutions
NorthBay Solutions is a privately held IT services firm that helps enterprises modernize on AWS through cloud migration, data engineering, and AI/ML solutions. An AWS Premier Consulting Partner founded in 2010 and headquartered in Andover, MA, it also partners with Snowflake and provides managed services, DevOps enablement, and application development. The company operates distributed teams across the US, Canada, UAE, India, and Pakistan.