GCP Data Engineer | BPCE-SI
Natixis in Portugal7 months ago
Portugal (city not specified)Senior
Responsibilities
- Design and execute migration strategies for data and ETL processes from SQL Server to GCP.
- Develop and optimize scripts and pipelines for transferring and transforming data into BigQuery.
- Design, develop, maintain, schedule, monitor, and debug ETL/ELT pipelines on GCP using Cloud Composer or Apache Airflow.
- Optimize BigQuery SQL queries, partitioning, clustering, schemas, performance, and cost management.
- Use Python to automate migration, transformation, integration, and interaction with GCP APIs.
- Implement data quality and integrity processes during and after migration.
- Collaborate with SQL Server administrators, analysts, business lines, data scientists, and end users to support the platform transition.
- Participate in code reviews, development best practices, testing strategies, monitoring, debugging, and incident resolution.
- Propose improvements based on cloud migration best practices and developments in Google Cloud Platform.
Requirements
- Significant experience with Google Cloud Platform and BigQuery schema design, complex SQL, performance optimization, and cloud cost management.
- Solid experience creating, scheduling, monitoring, and debugging Cloud Composer or Apache Airflow DAGs.
- Excellent SQL skills and the ability to adapt and optimize SQL for BigQuery.
- In-depth Python expertise for migration, automation, data transformation, and GCP API integration.
- Experience or strong understanding of on-premise SQL Server to GCP database migration methodologies and challenges.
- Strong analytical and problem-solving skills for analyzing existing systems, understanding business needs, and resolving migration and pipeline issues.
- English communication skills at B2 level or higher.
- Knowledge of SQL Server architecture, T-SQL, or basic administration is beneficial.
- Experience with GCP services such as Storage and Dataflow is beneficial.
- Knowledge of GCP migration tools such as Database Migration Service is beneficial.
- Experience with Power BI, Data Warehousing, Data Vault, data modeling, and code versioning is beneficial.
- Autonomy, rigor, organization, teamwork, technical curiosity, and adaptability are expected.
Benefits
- Hybrid work model with offices in Porto or Lisbon, Portugal.
- Green Transportation Budget and access to electric bikes.
- Flexible Hybrid Work Policy.
- Honolulu Wellness Club, Prayer Room, Lactation Room, and themed collaborative Villages.
- Inclusive ESG and DEI initiatives supporting wellbeing and equal participation.
- CVs must be submitted in English.
Tech Stack
Categories
Data Engineering
About Natixis in Portugal
Natixis in Portugal is a Centre of Expertise for Groupe BPCE, developing technology and shared services that support Corporate & Investment Banking and Asset & Wealth Management across the group. Teams in Porto and Lisbon deliver software engineering, banking operations support, and compliance services used by BPCE entities worldwide. Established in 2016, the unit operates as an internal service provider to one of France’s largest banking groups.