4 months ago
Tel Aviv-Yafo, IsraelSenior
Responsibilities
- Design, plan, and build all aspects of the platform's data and ML pipelines.
- Build and optimize an AWS-based Data Lake using cloud architecture best practices.
- Lead end-to-end data projects from initial design to production monitoring.
- Implement optimal ETL/ELT patterns and query techniques for data integration.
Requirements
- 5+ years of hands-on experience designing and maintaining big data pipelines.
- Proficiency in programming languages such as Python, Scala, Java, or Go.
- Expertise in SQL and NoSQL databases.
- Experience with software engineering best practices including testing and CI/CD.
- Experience developing data pipelines and maintaining data lakes on AWS.
- Familiarity with Kafka and workflow orchestration tools like Airflow.