9 days ago
Remote, Canada or Toronto, CanadaSenior
Base Salary
$72k - $139k/yr
Responsibilities
- Design, develop, and maintain scalable data processing applications using Apache technologies and SQL.
- Build high-performance ETL and data transformation pipelines with Python and Scala.
- Develop and optimize batch and near-real-time distributed data processing workflows.
- Work with large datasets stored in Parquet, Hive, HDFS, and distributed storage systems.
- Write efficient SQL queries and optimize execution plans for scalability.
- Design data models, partitioning strategies, and storage layouts to improve processing efficiency.
- Collaborate with data engineers, software engineers, data scientists, and product teams on data-driven solutions.
- Implement automated testing, monitoring, and deployment processes for data applications.
- Maintain data quality, reliability, security, and governance standards.
Requirements
- Bachelor’s or master’s degree in computer science, engineering, or a related technical field.
- At least five years of professional software engineering or data engineering experience.
- Strong hands-on experience with Apache technologies, SQL, Python, and Scala.
- Experience building distributed data processing applications and optimizing ETL pipelines for large-scale datasets.
- Strong knowledge of Hadoop ecosystem technologies, including Hive, Parquet, and HDFS.
- Strong SQL programming and query optimization skills.
- Familiarity with Linux environments and shell scripting.
- Experience using version control systems such as Git.
- Preferred qualifications include AWS experience, distributed computing and large-scale data architecture knowledge, Airflow orchestration experience, and experience with data lake and lakehouse environments.
Benefits
- Remote position in Canada.
- Paid time off, including vacation, company holidays, personal days, and sick leave, based on employee grade and policy.
- Medical, dental, and vision coverage, or provincial healthcare coordination in Canada.
- Retirement savings plans, including RRSP options in Canada.
- Life and disability insurance.
- Employee assistance programs and other benefits based on local policy and eligibility.
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.