2 months ago
Responsibilities
- Design GCP-native architectures using services such as BigQuery and Dataflow.
- Build and maintain data pipelines following medallion architecture patterns.
- Implement infrastructure as code using Terraform.
- Define and apply GCP landing zone standards.
- Develop end-to-end Lakehouse solutions on Databricks.
- Write and optimize PySpark and SQL workloads.
- Configure Databricks clusters and manage job scheduling.
- Advise clients on Databricks platform adoption.
- Lead technical workshops and requirements-gathering sessions.
- Produce high-quality client-facing deliverables.
- Present solution designs to client stakeholders.
- Manage technical dependencies and risks across delivery workstreams.
- Participate in sprint ceremonies within Agile frameworks.
- Implement data quality frameworks using various tools.
- Support data catalogue initiatives and metadata management.
- Ensure GDPR compliance in solution design.
- Contribute to internal knowledge-sharing initiatives.
- Stay current with GCP and Databricks product roadmaps.
Requirements
- Bachelor's degree in Computer Science, Engineering, or equivalent experience.
- 6+ years of hands-on experience in cloud data engineering or GCP roles.
- Google Cloud Professional Data Engineer or Cloud Architect certification.
- Databricks Certified Associate Developer for Apache Spark or Data Engineer certification.
- Advanced SQL skills with BigQuery.
- Experience with Cloud Storage, Cloud Functions, and Cloud Run.
- Proficiency in Dataflow for batch and streaming pipelines.
- Familiarity with Cloud Composer and Airflow.
- Experience with Pub/Sub for event-driven architectures.
- Knowledge of IAM, VPC, and Org Policies for security.
- Experience with Terraform for infrastructure as code.
- Proficiency in PySpark and SQL for data engineering.
- Familiarity with Git and version control practices.
- Basic knowledge of Docker and REST API integration patterns.
Benefits
- Flexibility with remote and hybrid work options.
- Career advancement opportunities with international mobility.
- Access to cutting-edge tools and training for learning and development.