1 day ago
Toronto, CanadaMid Level / Senior
Responsibilities
- Own end-to-end GenAI and ML solution design, including user workflows, data flows, model approaches, evaluation plans, and operational controls.
- Create system context diagrams, runtime sequences, agent and tool maps, data lineage, decision logs, specifications, and other design artifacts.
- Develop ML solutions for forecasting, classification, NLP, optimization, anomaly detection, and scenario analysis.
- Build GenAI capabilities such as retrieval-based solutions, structured summarization, transaction understanding, variance explanations, and tool-using workflows.
- Engineer features from structured and unstructured data and maintain solution stability as data evolves.
- Define performance expectations and implement backtesting, out-of-time testing, error analysis, scenario coverage, human review rubrics, quality scoring, and regression testing.
- Document model limitations and implement guardrails, monitoring, remediation actions, and evidence for governed model-risk review.
- Partner with Data Engineering, ML Engineering, and Software teams to productionize data pipelines, model packaging, deployment, monitoring, and operational support.
- Support business-user adoption and UAT, contribute to runbooks, and monitor data quality, drift, performance deterioration, and operational failures.
- Mentor junior scientists and help standardize design, coding, evaluation, and delivery practices.
Requirements
- 4–7 years of experience in applied data science or machine learning with demonstrated end-to-end production delivery, UAT support, and post-launch iteration.
- Strong Python and SQL skills with software engineering practices including Git workflows, code reviews, unit and integration testing, logging, readable code structure, and basic performance tuning.
- Hands-on experience with modern data science and machine learning tooling such as scikit-learn, PyTorch or TensorFlow, and Spark or Databricks.
- Ability to build and communicate solution architecture through clear diagrams and concise specifications covering data flow, runtime flow, interfaces, failure modes, and operational controls.
- Experience building and evaluating GenAI solutions using patterns such as RAG, structured summarization or extraction, LLM classification, tool or function calling, or agentic workflows.
- Strong ML and GenAI evaluation skills, including holdouts, backtesting, metric selection, error analysis, scenario coverage, edge cases, human review rubrics, and regression testing.
- Understanding of production readiness, including data-quality and drift monitoring, performance deterioration, GenAI cost and latency, and remediation approaches.
- Strong communication and collaboration skills, including explaining outputs, limitations, uncertainty, and design decisions in plain language.
- Preferred experience with multiple GenAI patterns, retrieval design, grounding, prompt and version management, caching, vector databases, embeddings, semantic search, and orchestration frameworks.
- Preferred experience with cloud data and ML stacks, model registries, APIs or microservices, monitoring, automation for retraining or refresh cycles, and GenAI guardrails.
- Experience in Finance, Treasury, Insurance, IFRS-17, Actuarial environments, or model governance is preferred.
- Ability to mentor peers through design reviews, code reviews, and evaluation practices without formal people leadership is preferred.
Benefits
- Hybrid working arrangement in Toronto, Ontario.
- Flexible environment supporting learning, career growth, well-being, and inclusion.
- Eligible employees may receive health, dental, mental health, vision, disability, life and AD&D insurance, adoption or surrogacy, wellness, and employee/family assistance benefits.
- Retirement savings plans, including pension and a global share ownership plan with employer matching contributions, plus financial education and counseling resources.
- Paid holidays, vacation, personal and sick days, and statutory leaves in Canada.
Tech Stack
Categories
About Manulife
Manulife is a Toronto‑headquartered public financial services company that provides life and health insurance, retirement plans, and wealth and asset management to individuals and institutions. It earns premiums and fee income from insurance, investment, and advisory products delivered across Canada, Asia, and Europe, and operates as John Hancock in the United States. Founded in 1887, the company is listed on the Toronto Stock Exchange.