Managing Director, AI Platform Architect
Baker Tilly1 day ago
San Francisco, CA, USA or Santa Clara, CA, USAStaff+
Base Salary
$350k - $550k/yr
Responsibilities
- Own the target-state architecture and architecture decision records for the AI product portfolio.
- Design the agent platform, including harnesses, orchestration, tool and MCP integration, retrieval, memory, context management, and shared services.
- Co-design the intelligence substrate, including ontologies, knowledge graphs, and judgment layers.
- Define model selection, routing, fallback, fine-tuning versus context strategies, portability, and cost-per-outcome economics.
- Prototype architectural patterns in code and review product architectures with engineering teams.
- Chair the technical design authority and lead the transfer of partner-built architecture into firm-owned standards, runbooks, and platforms.
- Establish evaluation-first engineering and define scalability, deployment, security, and observability architecture.
- Advise the CAITO on build, buy, and integration decisions and represent AI Product Group architecture to executives and enterprise architecture forums.
- Help hire and mentor founding engineers while raising standards for design, code quality, and technical decision-making.
Requirements
- Bachelor’s degree in computer science, engineering, or a related field, or equivalent practical experience; an advanced degree is a plus.
- 15+ years of experience in software and platform architecture or engineering, including director-level-or-above leadership or principal/consulting-architect scope.
- Recent hands-on experience taking LLM-based and agentic systems into production, including control planes, runtimes, gateways, SDKs, and developer experience.
- Personally designed and shipped an AI platform, agent framework, or ML platform at meaningful scale.
- Experience setting direction across multiple teams through standards, prototypes, and technical persuasion.
- Experience partnering with enterprise architecture, security, and governance functions in a large organization.
- Deep knowledge of orchestration frameworks, tool and function calling, MCP, vector and graph retrieval, context and memory management, and evaluation methodology.
- Strong data architecture experience with lakehouse platforms, semantic and graph modeling, data contracts, and structured and unstructured data pipelines.
- Knowledge of ontologies, knowledge graphs, GraphRAG, judgment or decision modeling, LLM gateways, routing, evaluation harnesses, observability, and token economics.
- Experience with enterprise APIs, event-driven patterns, data contracts, identity, and entitlements.
- Recent hands-on production coding and prototyping experience in Python and/or TypeScript.
- Founder or zero-to-one platform experience and the ability to use agentic tools for personal productivity are highly valued.
Benefits
- Baker Tilly offers a comprehensive compensation and benefits package to eligible employees.
- All qualified internal candidates will be considered regardless of their current geographic location.
- Work location requirements should be discussed with a Baker Tilly talent acquisition professional.
Tech Stack
Categories
About Baker Tilly
Baker Tilly provides audit/assurance, tax, and advisory services—including analytics, governance risk and compliance, and government contracting—to companies, public sector entities, and nonprofits. Headquartered in Chicago and organized as a partnership, it operates coast to coast in the U.S. and is an independent member of Baker Tilly International, with U.S. attest services delivered by Baker Tilly US, LLP and tax and advisory by Baker Tilly Advisory Group, LP.