Senior AI Platform Engineer
Arrowstreet Capital, L.P.4 months ago
Boston, MA, USASenior
Base Salary
$200k - $325k/yr
Responsibilities
- Design, build, and operate the shared AI platform, including managed LLM inference services, model access management, versioning, and routing across foundation models.
- Design and operate MCP servers, registries, gateways, authorization services, and integration layers connecting AI platforms with core firm systems.
- Build AI productivity data pipelines and dashboards for usage, cost, and adoption metrics.
- Design infrastructure for AI-assisted developer tooling, Linux VDI environments, M365 and Excel integrations, and autonomous agent frameworks.
- Develop reusable inference, agentic AI, RAG, vector database, and model integration components for adoption across engineering teams.
- Embed security controls across the AI lifecycle, including filesystem permissions, IAM policies, network allowlists, sandboxing, execution-time policy enforcement, and human-approval workflows.
- Implement default-deny access, pre-execution guardrails, policy engines, and private network connectivity for AI workloads.
- Build self-service onboarding, access controls, quota management, cost controls, chargeback visibility, and firm-wide AI service operations.
- Define reference architectures and standardized patterns for engineering teams building on the AI platform.
Requirements
- 10+ years of experience as an infrastructure, platform, or systems engineer building and operating shared services for multiple teams across on-premises and AWS environments.
- Strong expertise with AWS Bedrock, including inference and agent core, and Azure OpenAI.
- Strong expertise designing and implementing MCP registries, gateways, servers, and authorization flows.
- Hands-on experience supporting LLM-based workloads in production.
- Experience designing and enforcing AI security controls at the platform layer in regulated or security-sensitive environments.
- Production experience with agentic AI patterns including tool use, function calling, MCP gateways and servers, RAG, and human-in-the-loop workflows.
- Experience building production-quality platforms and developer-facing services with emphasis on usability, standardization, and reliability.
- Strong written and verbal communication skills and ability to collaborate across security, application, and infrastructure teams.
- Preferred experience in financial services, healthcare, or another heavily regulated industry.
- Preferred experience with Microsoft M365 Copilot, Copilot Agents, observability pipelines, containerized and Kubernetes-based environments, model fine-tuning workflows, ML lifecycle tooling, DLP tooling, and data classification frameworks.
Benefits
- Base salary range is $200,000–$325,000 per year, plus annual discretionary bonuses and a benefits package.
- The role is based in a Boston-based financial-services firm; no remote or hybrid arrangement is stated.
Tech Stack
Categories