Lead Data Engineer - Data Migration & Lakehouse
Squer Solutions GmbH28 days ago
Vienna, AustriaStaff+
Responsibilities
- Lead large-scale migrations from legacy SQL, ERP, and mainframe systems into modern cloud and lakehouse targets.
- Design and implement data pipelines using Spark, Delta Lake, Unity Catalog, Lakeflow Declarative Pipelines, and Databricks Asset Bundles.
- Own data modeling, schema mapping, and reconciliation across heterogeneous systems.
- Lead discovery and assessment activities, including documentation reviews, SME interviews, gap analyses, and requirements definition.
- Establish data quality frameworks and automated validation as team standards.
- Identify and communicate documentation gaps, structural mismatches, and other project risks to technical and non-technical stakeholders.
- Take full technical responsibility for complex migrations from discovery through delivery.
Requirements
- At least 5 years of data engineering experience.
- Several independently led large-scale legacy-to-cloud or legacy-to-lakehouse migrations.
- Hands-on mastery of Databricks, Spark, Delta Lake, Unity Catalog, Lakeflow Declarative Pipelines, and Databricks Asset Bundles.
- Strong data modeling and schema-mapping skills across heterogeneous systems, including mainframes and legacy ERPs.
- End-to-end discovery and assessment experience, including interviewing SMEs, identifying architecture gaps, and defining concrete requirements.
- Practical experience with data quality frameworks and automated validation, such as Great Expectations, dbt tests, or custom reconciliation tooling.
- Ability to communicate complex topics clearly and surface risks early to technical and non-technical stakeholders.
- Comfort using AI- and LLM-assisted tooling in data pipeline contexts.
- Preferred: experience with undocumented COBOL or mainframe systems, EDI, proprietary ERPs, metadata or data catalog tooling beyond Unity Catalog, agentic AI, or LLM-based schema-matching and entity-resolution tools.
Benefits
- €5,000 annual training budget, Leadership Academy access, and up to 40 hours per year of additional education leave.
- Hybrid work, flexible hours, EU workations, and additional vacation days.
- Preferred hardware configuration and AI tool licenses, including Anthropic and OpenAI.
- Central office with terrace and BBQ, free office lunch, MyClubs sports membership, and either a free Wiener Linien ticket or partial Klimaticket contribution.
- Free massages, referral bonuses, Corporate Benefits, JobRad, annual presents, monthly team breakfasts, and an annual company offsite.
- Flat hierarchies, diverse client projects, tech community events, meetups, hackathons, and training sessions.
Tech Stack
Categories
Data Engineering
About Squer Solutions GmbH
Squer Solutions GmbH is a Vienna-based software engineering and consulting firm that builds custom digital products and scalable platform solutions for clients via agile delivery. Services include end-to-end product development, cloud and platform engineering, security, DevOps, and agile enablement with team upskilling. Founded in 2019 and independently owned, it works as a services partner across IT and fintech, helping organizations implement and evolve software systems.