
Core Data - Big Data Engineer
Similarweb3 months ago
Tel Aviv-Yafo, IsraelMid Level
Responsibilities
- Design and implement complex, high-scale systems using a broad range of technologies.
- Retrieve, process, analyze, and generate customer-facing data from millions of digital users.
- Collaborate with data engineers, data scientists, and data analysts to solve data challenges and bring algorithms into production.
- Improve existing code infrastructure and data pipelines while eliminating performance bottlenecks.
- Experiment with machine learning and big data processing technologies.
- Build monitoring infrastructure for data pipelines to support reliable data ingestion and calculation.
- Demonstrate technical leadership and ownership of team products.
Requirements
- Bachelor of Science degree in Computer Science, Engineering, or a related technical field.
- At least four years of software or data engineering development experience.
- Programming experience with Python, Java, or Scala.
- Strong programming skills and knowledge of data structures, design patterns, and object-oriented programming.
- Understanding and experience with CI/CD practices and Git.
- Strong communication, prioritization, ownership, collaboration, and independent-working skills.
Benefits
- Partial work-from-home flexibility with in-office collaboration.
- Competitive compensation and benefits packages.
- Regular team outings and happy hours.
- Career development opportunities including Career Week, personalized coaching, and ongoing learning solutions.
- Inclusive workplace culture focused on equality, mutual respect, and belonging.
Tech Stack
Apache AirflowApache KafkaApache SparkAWSAzureDatabricksDockerGitGoogle Cloud PlatformJavaKubernetesPythonScala
Categories
Data Engineering