21 hours ago
Vancouver, CanadaStaff+
Base Salary
$150k - $176k/yr
Responsibilities
- Design, develop, and optimize scalable ETL/ELT pipelines using Databricks and PySpark.
- Build and maintain batch and real-time data ingestion frameworks.
- Develop data models and transformation logic using SQL and Python.
- Use Delta Lake for data management, data quality, and performance optimization.
- Implement orchestration workflows using Azure Data Factory, Airflow, or Databricks Workflows.
- Optimize Databricks jobs and Spark applications for performance, scalability, and cost efficiency.
- Implement data governance, security, and compliance best practices.
- Monitor and troubleshoot production data pipelines and support critical issues.
- Lead and manage a team of data engineers, define data engineering strategy, and ensure effective delivery of data solutions.
- Collaborate with data architects, analysts, data scientists, and business stakeholders.
- Participate in code reviews, documentation, and knowledge-sharing activities.
Requirements
- Strong or expert experience with Spark and PySpark.
- Hands-on experience developing data pipelines and ingestion patterns.
- Experience with Databricks, Python, SQL, Delta Lake, and cloud technologies such as Azure or AWS.
- Experience with data orchestration tools such as Azure Data Factory, Airflow, or Databricks Workflows.
- Experience with denormalized data modeling for big data systems.
- Ability to lead data engineers, provide technical expertise, and deliver scalable and reliable data infrastructure.
Benefits
- Paid time off, including 12–25 vacation days depending on employee grade, company holidays, personal days, and sick leave.
- Medical, dental, and vision coverage, or provincial healthcare coordination in Canada.
- Retirement savings plans such as 401(k) in the U.S. or RRSP in Canada.
- Life and disability insurance.
- Employee assistance programs and other benefits based on local policy and eligibility.
- Full-time regular employees receive a comprehensive, non-negotiable benefits package.
Tech Stack
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.