AI Systems Design Architect - Assistant Vice President
State Street24 days ago
Boston, MA, USA +2 moreSenior / Staff+
H1B sponsor
Base Salary
$90k - $158k/yr
Responsibilities
- Own end-to-end architecture and system design for a major AI platform domain, including model integration, orchestration, APIs, data flows, and downstream system interactions.
- Define reference architectures, design standards, integration contracts, and non-functional requirements.
- Translate business and product requirements into secure, resilient, scalable, and maintainable AI solution designs.
- Design cloud-based solutions using AWS, Azure, or Google Cloud while ensuring interoperability, scalability, observability, and operational readiness.
- Establish reusable architecture patterns for RAG, model serving, prompt workflows, agentic AI workflows, and AI application integration.
- Ensure alignment with Responsible AI, model governance, data handling, compliance, testing, risk, and production-control requirements.
- Conduct architecture assessments, technical design reviews, and proof-of-concept evaluations.
- Guide architecture decisions, trade-offs, standards adherence, production readiness, release architecture, monitoring, and scalability planning across pods.
Requirements
- Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline; a master’s degree is preferred.
- 8–14 years of experience in solution architecture, enterprise application architecture, platform architecture, or AI/ML architecture.
- Strong hands-on experience with Generative AI, LLMs, ML systems, RAG architectures, vector databases, and AI application integration.
- Experience designing cloud solutions on at least one major platform: AWS, Azure, or Google Cloud Platform.
- Strong understanding of cloud-native compute, storage, networking, identity and access management, security, and AI/ML services.
- Expertise in API architecture, microservices, distributed systems, event-driven architecture, and system integration patterns.
- Experience designing for security, resiliency, scalability, observability, and performance.
- Working knowledge of AI governance, Responsible AI, model risk, compliance, testing, and operational controls.
- Ability to lead architecture discussions and communicate complex technical concepts to technical and business stakeholders.
- Strong collaboration, problem-solving, and stakeholder management skills.
Benefits
- Comprehensive benefits including a 401(k) retirement savings plan with company match.
- Insurance coverage including basic life, medical, dental, vision, long-term disability, and optional additional coverages.
- Paid time off, vacation, sick leave, short-term disability, and family-care support.
- Employee Assistance Program and eligibility for annual performance-based incentive awards.
- Inclusive development opportunities, flexible work-life support, paid volunteer days, and employee networks.
Tech Stack
Categories
About State Street
State Street is a global custodian bank and asset manager serving institutional investors with investment servicing, fund accounting, trading/FX, data, and index/active strategies. Its products include State Street Global Advisors’ funds and ETFs, the Charles River Investment Management Solution, and the front-to-back State Street Alpha platform. Founded in 1792 and headquartered in Boston, the company is publicly traded on the NYSE (ticker: STT) and operates across major markets worldwide.