AI Engineer
CACI International3 days ago
Base Salary
$115k - $252k/yr
Responsibilities
- Build AI workflows and agents using established platform frameworks, tools, and reference architectures.
- Develop RAG pipelines covering document ingestion, chunking, embeddings, vector search, and retrieval tuning.
- Create prompt chains, tool calls, and agent logic for document generation, summarization, and task automation.
- Integrate workflows with Azure OpenAI, ServiceNow Flow Designer and APIs, and internal data sources.
- Build reusable components, templates, connectors, workflow orchestration, and business process automation.
- Develop test plans, evaluation datasets, automated evaluation harnesses, regression tests, and success metrics for AI workflows.
- Identify and remediate defects, hallucinations, performance issues, model drift, and data-quality problems.
- Prototype government-use-case solutions, collaborate with the AI Platform Architect and technical teams, and present results to customers and stakeholders.
- Support monitoring, logging, alerting, prompt and model versioning, CI/CD deployments, usage-cost tracking, and production operations.
- Implement DISA STIG, IL-5, CUI, data-classification, Department of the Air Force security, ATO, and continuous-monitoring requirements.
Requirements
- US citizenship and the ability to obtain and maintain a Secret clearance are required.
- At least 15 years of relevant experience is required; a relevant bachelor's degree may substitute for 5 years of relevant experience.
- Hands-on experience building LLM applications with RAG, prompt engineering, and agentic workflows is required.
- Proficiency in Python and experience with LangChain, LlamaIndex, or similar AI frameworks are required.
- Experience with Azure cloud services, including Azure OpenAI, AI Foundry, Azure DevOps, and API Management, is required.
- Experience with Docker, REST API development and integration, vector databases, and embedding strategies is required.
- Experience with test automation and QA for software or AI systems and ServiceNow integration or scripting is required.
- Ability to translate requirements into working solutions and communicate technical results to non-technical stakeholders is required.
- Familiarity with workflow orchestration tools and business process automation is required.
- Preferred qualifications include an active Secret clearance, Top Secret eligibility, Azure Government or AWS GovCloud experience, Kubernetes or AKS experience, DoD compliance knowledge, MLflow and MLOps experience, PostgreSQL and AI data-modeling experience, ATO experience, ServiceNow certification or development experience, and Security+ certification.
Benefits
- Full-time, regular employment with up to 10% local travel.
- Flexible time off, healthcare, wellness, financial, retirement, family support, continuing education, learning and development, and other time-off benefits.
- The position may be worked in more than one location.
Tech Stack
Categories
About CACI International
CACI International is a public government contractor that delivers enterprise IT, cybersecurity, electronic warfare, space, and intelligence solutions to U.S. defense, intelligence, and federal civilian customers. It provides systems engineering, software and data services, and mission support across C4ISR and business systems, primarily through long-term government contracts. Founded in 1962 and headquartered in Reston, Virginia, CACI trades on the NYSE under the ticker CACI.