Principal AI Cloud Engineer
BMO Financial Group2 months ago
Toronto, CanadaStaff+
Base Salary
$105k - $215k/yr
Responsibilities
- Design, build, and operate cloud-native AI infrastructure for ML and generative AI workloads, including GPU/CPU clusters, autoscaling, networking, storage, databases, and multi-region availability.
- Build secure APIs, SDKs, microservices, event-driven services, model-serving integrations, RAG infrastructure, and scalable LLM/ML serving platforms.
- Create CI/CD and GitOps pipelines, infrastructure-as-code modules, templates, and golden paths using Terraform and Bicep.
- Define AI cloud reference architectures and standards for Kubernetes, service mesh, ingress, serverless patterns, containerization, infrastructure-as-code, and secure networking.
- Implement observability, reliability, incident response, chaos testing, SLOs/SLIs, and SRE operating practices for AI infrastructure.
- Implement defense-in-depth security, IAM least privilege, secrets management, encryption, private networking, software bills of materials, image signing, data residency, lineage, and audit readiness.
- Drive FinOps initiatives including GPU rightsizing, caching, inference optimization, and cost governance.
- Lead infrastructure discovery and solution design with stakeholders, mentor engineers, and influence AI platform standards and roadmaps.
Requirements
- Bachelor’s, master’s, or PhD in computer science, engineering, or a related field.
- 7+ years building large-scale distributed cloud infrastructure.
- 5+ years of hands-on experience with Azure or AWS.
- Experience with AI/ML infrastructure including GPU clusters, Kubernetes, CI/CD, and observability.
- Strong infrastructure-as-code, Kubernetes, networking, security, container, service mesh, and serverless experience.
- Familiarity with MLOps/LLMOps infrastructure, model serving, feature stores, and vector databases.
- Programming experience in Python and one of Go or TypeScript.
- Understanding of frontend/backend integration for AI services.
- Preferred experience with GPU optimization, CUDA/NCCL, TensorRT-LLM, Prometheus, Grafana, OpenTelemetry, Kafka, Azure Event Hubs, Azure ML, MLflow, KServe, and Hugging Face.
Benefits
- Health insurance, tuition reimbursement, accident and life insurance, and retirement savings plans.
- Opportunity to influence enterprise AI and platform direction, ship systems used across multiple business lines, and receive leadership support for growth and thought leadership.
- Application deadline is November 30, 2026; listed address is 100 King Street West.
Tech Stack
Categories
About BMO Financial Group
BMO Financial Group is a publicly traded North American bank offering personal and commercial banking, wealth management, and capital markets services to consumers, businesses, and institutions. Founded in 1817 and headquartered in Toronto, it operates in Canada and the United States, including BMO Bank N.A. in the U.S. The company is listed on the NYSE and TSX under the symbol BMO.