21 days ago
Vancouver, CanadaStaff+
Base Salary
$103k - $184k/yr
Responsibilities
- Lead and manage a team of data engineers and execute the data engineering strategy.
- Design, develop, and optimize scalable ETL/ELT pipelines using Databricks and PySpark.
- Build data ingestion frameworks for batch and real-time processing.
- Develop data models and transformation logic using SQL and Python.
- Use Delta Lake for data management, quality, and performance optimization.
- Implement orchestration workflows using Azure Data Factory, Airflow, or Databricks Workflows.
- Optimize Databricks jobs and Spark applications for scalability, performance, and cost efficiency.
- Collaborate with data architects, analysts, data scientists, and business stakeholders.
- Monitor and troubleshoot production data pipelines and support critical issues.
- Implement data governance, security, and compliance best practices and participate in code reviews and documentation.
Requirements
- Strong or expert Spark and PySpark experience using Jupyter Notebooks, Colab, or Databricks.
- Hands-on data pipeline development and data ingestion patterns in Azure.
- Experience with orchestration tools such as Azure Data Factory or Airflow.
- Strong SQL experience and experience with denormalized data modeling for big data systems.
- Experience building enterprise-scale data solutions supporting analytics, reporting, and machine learning workloads.
- Experience leading and managing data engineering teams and delivering reliable, scalable data infrastructure.
Benefits
- Comprehensive benefits package for regular full-time employees, including paid time off, company holidays, personal days, and sick leave.
- Medical, dental, and vision coverage, or provincial healthcare coordination in Canada.
- Retirement savings plans such as 401(k) in the U.S. and RRSP in Canada.
- Life and disability insurance and employee assistance programs.
- Additional benefits may be available according to local policy and eligibility.
Tech Stack
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.