AI Senior Software Engineer
Soft Tech Consulting12 days ago
Washington, DC, USASenior
Responsibilities
- Design, build, and optimize agentic AI systems using LangGraph, CrewAI, Google ADK, AWS Bedrock AgentCore, and related orchestration frameworks.
- Implement multi-step, tool-enabled AI workflows combining LLM reasoning, RAG, retrieval systems, external APIs, and enterprise tools.
- Use Claude Sonnet, Claude Opus, and Amazon Bedrock to develop structured generation, extraction, summarization, planning, and decision-support capabilities.
- Tune AI workflows through prompt engineering, instruction design, agent configuration, and tool-use optimization.
- Conduct regression testing, scenario-based evaluations, synthetic test creation, and model-to-model comparisons.
- Diagnose hallucinations, retrieval mismatches, tool-use errors, and unexpected agent behavior, and implement guardrails and workflow corrections.
- Integrate AI components with vector databases, graph databases, internal applications, and infrastructure tools.
- Document model usage, agent behavior, experiments, workflow designs, and best practices.
- Collaborate with software engineering, data science, solution architecture, cybersecurity, governance, and product teams.
Requirements
- Top Secret clearance and United States citizenship are required.
- Bachelor's degree is required.
- 7–10 years of related experience is required.
- Advanced experience tuning, evaluating, and validating AI workflows, including prompts, agent configurations, tool-calling patterns, and retrieval strategies.
- Experience designing structured AI behavior tests, including regression, scenario-based, synthetic, and model-comparison testing.
- Experience diagnosing AI failures and implementing guardrails or workflow adjustments.
- Proficiency in Python and familiarity with data modeling and AWS Bedrock services.
- Experience with AI agents and workflow integration, AI prompting, AWS AI services, AI architecture, and Python software development.
- Comfort with Git-based development workflows, CI/CD, and observability integrations for logging, metrics, and traces.
- Strong written and verbal communication, independent work ability, and client relationship skills.
- A master's degree in Computer Science is preferred.
Benefits
- Medical, dental, and vision insurance.
- 401(k).
- Short-term and long-term disability insurance.
- Life insurance.
- Paid time off and paid holidays.
- 100% onsite work in Washington, DC.
- No third-party vendors; Top Secret clearance and U.S. citizenship are required.
Tech Stack
Categories