AI Engineer
Booz Allen Hamilton6 hours ago
Washington, DC, USAMid Level
H1B sponsor
Base Salary
$99k - $225k/yr
Responsibilities
- Design and deliver production-grade AI systems for secure, mission-critical federal environments.
- Build and own RAG pipelines, embedding and retrieval workflows, vector search, prompt engineering, and agent orchestration.
- Design APIs and services, deploy AI workloads, and manage model configurations, prompt versions, and structured outputs.
- Implement observability through logging, tracing, and metrics for latency, throughput, token usage, cache performance, and errors.
- Optimize performance using caching, parallelization, asynchronous workflows, and retrieval tuning.
- Create automated evaluation pipelines using benchmark datasets, LLM-as-a-judge methods, regression testing, and human evaluation.
- Support production AI services through monitoring, incident response, debugging, performance tuning, and operational maintenance.
- Apply AI security practices addressing prompt injection, jailbreak resistance, data leakage, guardrails, secure prompting, and responsible AI.
Requirements
- At least 3 years of experience building production systems, including AI/ML applications.
- Experience building LLM systems with RAG frameworks such as LangChain and LlamaIndex, or custom pipelines and vector stores.
- Experience designing embedding pipelines involving document ingestion, chunking, indexing, metadata filtering, retrieval optimization, and hybrid search.
- Experience designing APIs and services using FastAPI, Flask, or Node.js.
- Experience with cloud-native AWS architectures and services, agent frameworks, and orchestration patterns.
- Experience implementing observability with logging, tracing, and metrics pipelines.
- Experience optimizing performance with caching, parallelization, asynchronous workflows, and retrieval tuning.
- Knowledge of AI security concepts and responsible AI practices.
- Ability to obtain a TS/SCI clearance.
- Bachelor's degree.
- Preferred experience includes DoD or federal mission environments, high-performance inference systems, semantic caching, guardrail frameworks, enterprise data platforms, secure cloud environments, event-driven architectures, messaging technologies, and Model Context Protocol.
Benefits
- Hybrid work in Washington, DC or McLean, Virginia, with frequent work at a Booz Allen facility and possible customer-facility visits.
- Benefits include health, life, disability, financial, and retirement benefits; paid leave; professional development; tuition assistance; work-life programs; and dependent care.
- Recognition awards and eligibility for benefit programs are available to regular full-time and part-time employees working at least 20 hours per week.
- The role is full-time and the posting is expected to close within 90 days of the posting date.
Tech Stack
Categories
About Booz Allen Hamilton
Booz Allen Hamilton builds and integrates software, analytics, AI, cloud, and cybersecurity solutions while providing engineering and consulting services, primarily for U.S. defense, intelligence, and civil government clients, with select commercial partnerships. Its business is largely government contracting and professional services delivering mission systems and cyber defense. Founded in 1914 and headquartered in McLean, Virginia, Booz Allen is a public company traded on the NYSE (ticker: BAH).