7 days ago
Vancouver, CanadaSenior
Responsibilities
- Build and support batch, distributed, and real-time data pipelines and highly available data capabilities.
- Develop fault-tolerant, self-healing, adaptive, and accurate computational pipelines.
- Implement data ingestion patterns and orchestration solutions in Azure.
- Tune distributed queries running over billions of rows of data.
- Provide consultation and lead complex program implementations.
- Lead and manage a team of data engineers and collaborate with stakeholders.
- Maintain system and project documentation.
- Perform root cause analysis and implement permanent resolutions to software or business-process issues.
Requirements
- Strong or expert experience with Spark and PySpark.
- Hands-on experience developing data pipelines and ingestion patterns in Azure.
- Experience with orchestration tools such as ADF or Airflow.
- Experience with SQL and denormalized data modeling for big data systems.
- Experience with Jupyter Notebooks, Colab, or Databricks is preferred.
- Deep knowledge of data engineering and experience delivering reliable, scalable data solutions.
Tech Stack
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.