Principal Cloud Engineer AI
BMO Financial Group2 months ago
Base Salary
$120k - $250k/yr
Responsibilities
- Design, build, and operate cloud-native AI infrastructure for ML and GenAI workloads, including GPU/CPU clusters, autoscaling, networking, storage, databases, and security controls.
- Build reusable APIs, SDKs, microservices, pipelines, IaC modules, templates, and golden paths for AI platform components.
- Operationalize LLMs, ML models, RAG systems, model serving, embeddings, retrieval pipelines, and token or inference optimization.
- Implement observability, reliability, SLOs/SLIs, incident response, chaos testing, and other SRE practices for AI infrastructure.
- Create and evolve Azure- and AWS-based reference architectures covering Kubernetes, service mesh, ingress, serverless patterns, multi-region availability, disaster recovery, and compliance.
- Drive FinOps initiatives such as GPU rightsizing, caching, inference optimization, and infrastructure cost governance.
- Implement defense-in-depth security and Responsible AI controls, including IAM, private networking, encryption, secrets management, SBOMs, image signing, data residency, lineage, and audit readiness.
- Lead infrastructure discovery and solution design with stakeholders, influence technical standards and roadmaps, and mentor engineers.
Requirements
- Bachelor’s, master’s, or PhD in computer science, engineering, or a related field.
- At least 7 years of experience building large-scale distributed cloud infrastructure.
- At least 5 years of hands-on experience with Azure or AWS.
- Proven experience with AI/ML infrastructure, including GPU clusters, Kubernetes, CI/CD, and observability.
- Strong expertise in infrastructure as code, Kubernetes, networking, security, containers, service mesh, and serverless architectures.
- Familiarity with MLOps/LLMOps infrastructure, model serving, feature stores, and vector databases.
- Programming experience in Python and one of Go or TypeScript for tooling and infrastructure automation.
- Understanding of frontend and backend integration for AI services.
- Preferred experience with GPU optimization, CUDA/NCCL, TensorRT-LLM, Prometheus, Grafana, OpenTelemetry, Kafka or Azure Event Hubs, Azure ML, MLflow, KServe, and Hugging Face.
Benefits
- Health insurance, tuition reimbursement, accident and life insurance, and retirement savings plans.
- Opportunities for training, coaching, manager support, network building, professional growth, and thought leadership.
- The role influences enterprise-wide AI platform direction and supports systems used across multiple business lines and products.
Tech Stack
Categories
About BMO Financial Group
BMO Financial Group is a publicly traded North American bank offering personal and commercial banking, wealth management, and capital markets services to consumers, businesses, and institutions. Founded in 1817 and headquartered in Toronto, it operates in Canada and the United States, including BMO Bank N.A. in the U.S. The company is listed on the NYSE and TSX under the symbol BMO.