Director, Cloud AI Platform Engineering
RSM International3 days ago
Base Salary
$134k - $269k/yr
Responsibilities
- Design and deploy AI landing zones on Azure and AWS, including networking, identity, policies, logging, and private endpoints.
- Deploy model and agent infrastructure using Azure AI Foundry, Azure OpenAI, Amazon Bedrock, SageMaker, Anthropic, OpenAI, and open-weight models.
- Build infrastructure for RAG and agents, including vector stores, orchestration, MCP servers, and API gateways.
- Codify infrastructure with Terraform or Bicep and deliver it through CI/CD pipelines.
- Containerize, secure, test, and instrument prototype and custom AI applications for production scale.
- Implement AI guardrails such as content filtering, prompt-injection defenses, data loss prevention, and least-privilege access.
- Operate LLMOps processes including model versioning, evaluation, monitoring, drift and quality alerts, and incident response.
- Control AI costs through token and GPU monitoring, chargeback, quotas, caching, and capacity planning.
- Transition platforms into Managed IT Services with runbooks, SLAs, and handoff to shared or dedicated teams.
- Scope platform work, estimate effort, contribute to SOWs and assessments, advise client technology leaders, and develop reusable accelerators and reference architectures.
Requirements
- At least 5 years of experience in cloud, platform, or DevOps engineering.
- At least 1 year of experience deploying generative AI workloads in production.
- Hands-on depth in Azure or AWS, with working knowledge of the other platform.
- Experience with Terraform or Bicep and CI/CD using GitHub Actions or Azure DevOps.
- Experience with Docker, Kubernetes including AKS or EKS, or serverless equivalents.
- Python plus one of TypeScript or Go.
- Experience with cloud identity and security tools such as Entra ID or IAM, Key Vault or Secrets Manager, and private networking.
- Experience with observability tools such as Azure Monitor, CloudWatch, Datadog, or OpenTelemetry.
- Client-facing experience in consulting or a managed services provider.
- Ability to travel to client sites up to 25%.
- A bachelor's degree in a technical field or equivalent experience is preferred.
- Preferred certifications include Azure AI Engineer Associate, Azure Solutions Architect Expert, AWS Certified Machine Learning or GenAI Developer, HashiCorp Terraform Associate, and FinOps Certified Practitioner.
- Preferred experience includes AI gateways and LLMOps tools, agent frameworks and protocols, Microsoft 365 Copilot, Copilot Studio, Purview data governance, GPU capacity planning, cost management, and mid-market or PE-backed portfolio companies.
Benefits
- Competitive benefits and compensation package with access to RSM’s total rewards program.
- Most roles follow a hybrid workstyle aligned to an RSM office, with in-person work based on client, team, development, and relationship-building needs; some roles may be virtual or primarily on-site.
- The role may require travel to client sites up to 25%.
Tech Stack
Categories
About RSM International
RSM International is a global network of independent firms providing audit, tax, and consulting services to middle‑market and growth enterprises. Member firms deliver offerings such as assurance, risk and cyber advisory, transaction support, outsourcing, and IFRS/GAAP accounting, while the network supplies common standards, tools, and branding. Founded in 1964 and headquartered in London, it coordinates practices across many countries to serve privately held, public, and public‑sector organizations.