Enterprise AI Orchestration Architect, Senior Manager
Booz Allen Hamilton23 hours ago
Base Salary
$163k - $303k/yr
Responsibilities
- Build reusable enterprise AI agents and intelligent applications for customer solutions from demonstration through production.
- Develop agent behavior, orchestration, workflow state, retrieval-augmented generation, tool integrations, memory, and human oversight.
- Implement validation, permissions, approval steps, error handling, fallback behavior, and enterprise API integrations.
- Instrument model calls, tool execution, state transitions, and outcomes using logs or distributed traces.
- Create evaluation datasets and regression tests covering task success, groundedness, safety, tool correctness, latency, and cost.
- Diagnose application failures and distinguish agent behavior defects from data, platform, or customer configuration issues.
- Partner with Platform, Data, and Forward-Deployed Engineering to deliver reusable components, integration contracts, and deployment guidance.
- Document interfaces and limitations and improve customer readiness and application quality.
Requirements
- 10+ years of experience building maintainable applications, APIs, and automated tests using version control and software engineering practices.
- Proficiency in Python or TypeScript.
- Experience integrating large language models into applications, including prompt and context management, structured outputs, and tool calling.
- Experience implementing agent orchestration, workflow state, retrieval-augmented generation, and enterprise API integrations.
- Experience instrumenting model calls, tool execution, state transitions, and outcomes with logs or distributed traces.
- Experience developing evaluation datasets and regression tests for task success, groundedness, safety, tool correctness, latency, and cost.
- Ability to design human approval steps, tool permissions, input and output validation, error handling, and fallback behavior.
- Ability to document interfaces and limitations and collaborate on customer readiness and reusable engineering improvements.
- Bachelor’s degree required.
- Preferred experience includes LangGraph, Semantic Kernel, MCP, OpenTelemetry, LangSmith, Langfuse, multi-agent coordination, memory design, reusable SDKs, reference architectures, and full-stack AI applications.
Benefits
- Health, life, disability, financial, and retirement benefits.
- Paid leave, professional development, tuition assistance, work-life programs, and dependent care support.
- Recognition awards program for exceptional performance and demonstration of company values.
- Regular full-time and part-time employees working at least 20 hours per week are eligible for Booz Allen benefit programs, with select offerings available below that threshold.
- Employees working virtually are generally expected to have cameras on during meetings; remote roles may occasionally require work at a Booz Allen or customer facility, while hybrid and onsite arrangements follow leadership and customer requirements.
Tech Stack
Categories
About Booz Allen Hamilton
Booz Allen Hamilton builds and integrates software, analytics, AI, cloud, and cybersecurity solutions while providing engineering and consulting services, primarily for U.S. defense, intelligence, and civil government clients, with select commercial partnerships. Its business is largely government contracting and professional services delivering mission systems and cyber defense. Founded in 1914 and headquartered in McLean, Virginia, Booz Allen is a public company traded on the NYSE (ticker: BAH).