Expert Data Engineer - Focus Databricks
Zühlke Group2 months ago
Hamburg, Germany or Munich, GermanySenior
Responsibilities
- Collaborate with clients to understand business needs and translate them into robust technical data solutions.
- Design, build, and maintain scalable data pipelines and ETL/ELT processes.
- Lead the architecture and implementation of Databricks data platforms using Delta Lake, workflows, jobs, cluster management, and Unity Catalog.
- Set up and maintain cloud infrastructure using infrastructure-as-code and CI/CD practices.
- Prioritize data quality, governance, and security throughout platform development.
- Optimize data processing for performance, reliability, and cost efficiency.
- Collaborate with data scientists, analysts, and software engineers on integrated data platforms.
- Mentor junior engineers and contribute to internal engineering practices and knowledge sharing.
Requirements
- Hands-on expertise with Databricks, Delta Lake, Spark, workflows, jobs, and Unity Catalog.
- Strong daily programming skills in SQL and Python.
- Proficiency with Azure and/or AWS and familiarity with lakehouse and data warehousing approaches.
- Experience with pipeline orchestration tools such as Airflow, Databricks Workflows, or dbt.
- Knowledge of clean software engineering practices, infrastructure-as-code, CI/CD, and DevOps.
- Several years of professional data engineering experience, ideally in client-facing consulting roles.
- Ability to solve problems independently in fast-paced and changing environments.
- Fluency in German and English for communication with clients and colleagues.
- University degree in computer science, mathematics, or a related field.
Benefits
- Flexible working hours and the possibility to work from home.
- Eligibility for a company profit-share scheme.
- Global and diverse community spanning 16 offices, with team camps, year-end parties, and local festivities.
- Investment in professional and personal development.
- Inclusive workplace welcoming people from all backgrounds.
Tech Stack
Categories
Data Engineering
About Zühlke Group
Zühlke Group provides technology consulting, product engineering, and digital solutions for enterprises, especially in regulated sectors such as healthcare and finance. It builds custom software, connected devices, and data-driven services, and supports clients from strategy through implementation and operations. Founded in Switzerland in 1968 and headquartered in Schlieren, Zurich, the firm is partner-owned, operates across Europe and Asia, and also invests in startups via Zühlke Ventures.