
Lead ETL Developer / Technical Architect - Big Data & Credit Risk (Databricks) (all humans)
Erste Group Bank AG23 days ago
Vienna, AustriaStaff+
Responsibilities
- Define and own end-to-end architecture for enterprise Credit Risk data platforms.
- Design scalable ETL/ELT solutions using Databricks Lakehouse architecture, Spark, and cloud-native technologies.
- Lead development of large-scale data ingestion and processing pipelines across structured and semi-structured source systems.
- Design enterprise data models for Risk Analytics and Credit Risk, including data layers, ingestion zones, curation processes, and consumption models.
- Establish architectural standards, reusable design patterns, coding practices, engineering governance, and technology roadmaps.
- Review and approve technical designs, data models, and integration approaches.
- Optimize data processing, storage, compute performance, scalability, resilience, and security.
- Implement metadata management, data lineage, data quality, governance, and platform observability capabilities.
- Provide technical leadership, mentoring, solution governance, stakeholder management, and delivery oversight.
- Support production issue resolution, root cause analysis, operational support, and continuous improvement.
Requirements
- Extensive experience designing and delivering enterprise-scale Databricks Lakehouse solutions.
- Strong data engineering and data modelling expertise, including Data Vault, dimensional modelling, star schemas, canonical data models, and Lakehouse architectures.
- Proven end-to-end solution delivery experience spanning requirements analysis, architecture, development, testing, deployment, productionisation, operational support, and continuous improvement.
- Advanced hands-on expertise across Azure, Databricks, GCP, AWS, and dbt.
- Extensive experience building and optimizing ETL/ELT frameworks with Spark, PySpark, SQL, Delta Lake, and cloud-native services.
- Strong knowledge of data quality, data lineage, metadata management, data governance, and platform observability.
- Experience leading cross-functional teams using Scrum, Kanban, and SAFe methodologies.
- Demonstrated technical mentoring, solution governance, stakeholder management, and delivery leadership capabilities.
- Expertise with Python, SQL, SQL Server, Oracle, PostgreSQL, Snowflake, Teradata, Git, Azure DevOps, GitHub, Jenkins, CI/CD pipelines, and Terraform.
- Ability to translate complex credit risk and analytics requirements into robust technical solutions across business and technology teams.
Benefits
- International community of talented and passionate colleagues with opportunities to learn and collaborate.
- Interest groups and clubs for discussions and project participation.
- Fully equipped Erste Campus Health Centre offering medical services during working hours.
- Employee discounts and special conditions for financial services, insurance, supermarkets, clothing stores, and other services.
- Employee Referral Program with rewards for successful IT referrals.
- Competitive performance-related salary; the stated collective-agreement minimum is EUR 64,554 gross per year.
- Equal-opportunity workplace emphasizing diversity and inclusion.
Tech Stack
Apache SparkAWSAzureDatabricksdbtGitGoogle Cloud PlatformJenkinsMicrosoft SQL ServerPostgreSQLPythonSnowflakeSQLTerraform
Categories
Data Engineering