Data Engineer
Blanc Labs4 months ago
Remote, CanadaMid Level
Responsibilities
- Design, build, and maintain scalable data pipelines using Azure Databricks and Apache Spark.
- Develop and optimize ETL/ELT processes with Azure Data Factory and Azure Databricks.
- Implement change data capture solutions using Azure SQL CDC, Debezium, or Delta Live Tables.
- Write maintainable Python code for data processing and automation.
- Translate business requirements into data pipeline designs on Azure Synapse Analytics and Azure Databricks.
- Monitor, troubleshoot, and optimize pipeline performance, reliability, and cost efficiency.
- Ensure data quality, consistency, and integrity across ingestion, transformation, and storage layers.
- Integrate structured and unstructured data into unified platforms using Microsoft Fabric and Azure Synapse.
- Support analytics, reporting, Power BI, and downstream AI/ML use cases.
- Participate in code reviews, document pipelines and architecture, and promote data engineering best practices.
Requirements
- At least 3 years of experience in data engineering or a related field.
- Strong hands-on experience with Azure Databricks for data processing and analytics workloads.
- Proficiency with Apache Spark for large-scale distributed data processing.
- Experience implementing change data capture solutions using tools such as Debezium, Azure SQL CDC, or Delta Live Tables.
- Strong Python programming skills for data engineering tasks.
- Strong understanding of SQL and relational database concepts, particularly Azure SQL Database and SQL Managed Instance.
- Experience building and maintaining production ETL/ELT pipelines using Azure Data Factory and/or Databricks Workflows.
- Understanding of data modeling and data warehousing concepts, including Azure Synapse Analytics dimensional and lakehouse modeling.
- Strong analytical, problem-solving, and communication skills, with the ability to work across technical and business teams.
Tech Stack
Categories
Data Engineering
About Blanc Labs
Blanc Labs is a Toronto-based technology services firm that designs and implements digital transformation solutions—custom software, systems integration, cloud enablement, automation, and data platforms—for enterprises, especially in financial services. The company operates across the Americas (Toronto, New York, Bogotá, Buenos Aires) and is privately held, founded in 2013. Its business model centers on consulting and delivery of tailored platforms and managed solutions to modernize customer experience and core operations.