1 month ago
Canada (city not specified)Mid Level
Responsibilities
- Design, develop, and maintain data feeds and integration pipelines from source systems through downstream delivery.
- Integrate data from REST APIs, SFTP files, SQL Server, Snowflake, and other sources.
- Develop Python applications and scripts for ingestion, transformation, validation, reconciliation, and processing.
- Develop and support Snowflake pipelines using stages, Snowpipe, Streams, Tasks, stored procedures, and incremental-loading patterns.
- Apply Data Vault modeling principles, including Hubs, Links, Satellites, hash keys, and hash differences.
- Write and troubleshoot T-SQL for extraction, transformation, validation, reconciliation, and processing.
- Containerize Python data-processing applications with Docker and run them as AWS ECS tasks.
- Monitor and troubleshoot production data feeds and pipelines across APIs, SFTP, databases, processing systems, and downstream systems.
- Implement error handling, logging, monitoring, and retry mechanisms for reliable production data feeds.
- Collaborate with technical and business stakeholders to resolve data issues and support end-to-end integration workflows.
- Maintain technical documentation for pipelines, integrations, data models, and operational procedures.
Requirements
- Production experience developing data feeds, data integrations, or data pipelines.
- Strong Python development experience involving data processing and transformation.
- Strong hands-on experience with Microsoft SQL Server and T-SQL, including complex queries, joins, CTEs, aggregations, data manipulation, views, and stored procedures.
- Hands-on experience with Snowflake querying, loading, transformation, validation, and pipeline development.
- Experience with Data Vault modeling and incremental data-loading patterns.
- Experience developing and supporting Snowflake pipelines using stages, Snowpipe, Streams, Tasks, and stored procedures.
- Hands-on experience integrating REST APIs, including authentication, response handling, error handling, and pagination.
- Hands-on experience with SFTP and file-based data integrations.
- Experience processing JSON, CSV, and XML data.
- Basic working knowledge of Docker and AWS ECS for running containerized workloads.
- Strong troubleshooting and problem-solving skills in production data and integration environments.
- Familiarity with version control and standard software development lifecycle practices.
- Preferred experience with AWS services including ECS, S3, CloudWatch, IAM, and Secrets Manager.
- Preferred experience with Kafka or similar event-streaming and message-broker technologies.
- Preferred experience with CI/CD pipelines and tools such as Harness, GitHub Actions, GitLab CI, or Jenkins.
- Preferred experience with MongoDB and infrastructure-as-code tools such as Terraform or CloudFormation.
- Preferred experience implementing data quality, validation, reconciliation, monitoring, alerting, and operational support processes.
- Familiarity with AWS networking and security concepts and Agile/Scrum development environments.
Benefits
- Full-time, permanent employment.
- Four weeks of cumulative vacation starting from day one.
- Flexible working hours.
- Professional Development Allowance for training, computer equipment, and physical activities.
- Training tailored to areas of expertise.
- RRSP with employer contributions of up to 3% of gross salary.
- Modular group insurance plan.
- Public transportation or parking reimbursement when required.
- Referral bonuses, 11 statutory holidays, and personal days.
- Social activities, social club, healthy snacks, and coffee.
Tech Stack
Categories
Data Engineering
About Levio
Levio is a Quebec City–based technology consulting and systems integration firm delivering digital transformation for enterprises and the public sector. It provides services in cloud, cybersecurity, data platforms, and applied AI (including hyperautomation and data mesh). Founded in 2014 and privately held, it serves clients in finance, insurance, healthcare, aerospace, retail, and government, and received private‑equity investment in 2024.