Staff AI Platform & Agent Runtime Engineer
EQ Bank | Canada2 months ago
Toronto, CanadaStaff+
Responsibilities
- Define the enterprise AI platform architecture and roadmap.
- Design, build, and operate AI-native delivery platforms for ML, LLM, prompt, and agent lifecycles.
- Implement secure-by-design AI controls, governance, reliability, observability, resilience, and FinOps practices.
- Lead architecture reviews and developer enablement programs.
- Provide technical leadership across engineering teams and stakeholders.
- Build and operate agent runtime infrastructure supporting memory, tools, planning, model routing, evaluation, and observability.
Requirements
- Require 7+ years of software, platform, or cloud engineering experience, including 3+ years in AI/ML platforms or agentic AI systems.
- Require hands-on expertise with Azure, including AKS, networking, private endpoints, identity, Key Vault, and Azure AI Foundry or an equivalent AI platform.
- Require experience building delivery pipelines for ML/LLM workloads and managing model, prompt, and agent lifecycles.
- Require a strong background in distributed systems, Kubernetes, container orchestration, and API/SDK design.
- Require experience with Semantic Kernel, LangChain, AutoGen, or comparable agent frameworks and orchestration patterns.
- Require understanding of LLM inference optimization, model routing, evaluation, and observability.
- Require experience establishing platform standards, paved paths, and developer enablement at scale.
- Prefer experience in financial services, banking, insurance, Microsoft Fabric, Power Platform, Copilot, Copilot Studio, AI FinOps, Responsible AI, model governance, evaluation frameworks, or open-source AI/agent platform projects.
Tech Stack
Categories