3 months ago
Canada (city not specified)Staff+
Responsibilities
- Participate in requirements gathering, analysis, design, development, testing, UAT support, deployment, and post-production support.
- Design, develop, maintain, and optimize data pipelines and workflows using Python, Snowflake, Azure Data Factory, and/or Microsoft Fabric.
- Build cloud-native ingestion, staging, transformation, and curated data layers for analytics and warehousing.
- Develop and tune complex SQL queries, stored procedures, and views for extraction, transformation, and validation.
- Write and maintain UNIX/Linux shell scripts for scheduling, file handling, automation, and workflow orchestration.
- Perform data profiling, data quality checks, error handling, performance tuning, troubleshooting, and root-cause analysis.
- Prepare technical design documents, source-to-target mappings, test cases, deployment plans, runbooks, and other documentation.
- Support migration and modernization activities involving Snowflake, Azure Data Factory, and/or Microsoft Fabric.
- Collaborate with business, QA, infrastructure, DBA, project management, and stakeholder teams to deliver projects.
- Provide effort estimates, status updates, risk assessments, permanent fixes, and adherence to version control and release processes.
Requirements
- Bachelor's degree or foreign equivalent from an accredited institution, or three years of progressive specialty experience in lieu of each year of education.
- At least four years of Information Technology experience, including hands-on data engineering or ETL/ELT development.
- Strong hands-on Python experience for data pipeline development, automation, and scripting, including libraries such as pandas or PySpark.
- Experience with Snowflake data pipelines, warehousing, Streams, Tasks, Pipes, warehouses, access controls, and performance or cost optimization.
- Experience with Azure Data Factory and/or Microsoft Fabric for data integration, orchestration, and transformation.
- Strong SQL proficiency, including complex queries, joins, stored procedures, and performance tuning.
- Strong UNIX/Linux shell scripting skills for automation, scheduling, and file or data handling.
- Experience with ETL/ELT performance tuning, troubleshooting, data warehousing, dimensional modeling, and data governance.
- Experience across project phases and with Agile/Scrum or Waterfall environments.
- Experience coordinating with cross-functional teams and preparing technical design, testing, deployment, and release documentation.
- Familiarity with Git, change management, release management, and scheduling or orchestration tools such as Airflow, Control-M, Autosys, or ADF triggers and pipelines.
- Additional experience with Azure Synapse, Databricks, AWS Redshift, API integrations, event-driven or streaming pipelines, Informatica, and CI/CD pipelines is preferred.
Benefits
- Estimated annual compensation is CAD 92,740–123,375 in Ontario and CAD 90,450–136,500 in British Columbia.
- Candidates must be within commuting distance of Mississauga, Calgary, or Burnaby, or willing to relocate; relocation and travel may be required.
- The role involves extended periods of sitting and computer work and communication by telephone, email, or face to face.
Tech Stack
Categories
Data Engineering
About Infosys
Infosys is a public IT services and consulting company that builds and runs software systems for large enterprises across industries. It provides consulting, systems integration, cloud and AI services, engineering, and business process outsourcing, and sells platforms such as EdgeVerve's Finacle core banking suite. Founded in 1981 and headquartered in Bangalore, it serves clients in 50+ countries and is listed on the NSE, BSE, and NYSE.