
AI Mid Software Engineer
Soft Tech Consulting12 days ago
Washington, DC, USAMid Level
Base Salary
$120k - $165k/yr
Responsibilities
- Design, build, and optimize agentic AI systems with LangGraph, CrewAI, Google ADK, or AWS Bedrock AgentCore.
- Implement multi-step, tool-enabled workflows integrating LLM reasoning, retrieval-augmented generation, external APIs, and enterprise tools.
- Use foundation models on Amazon Bedrock for structured generation, extraction, summarization, planning, and decision support.
- Tune prompts, agent configurations, instructions, retrieval strategies, and tool-use behavior.
- Conduct regression tests, scenario-based evaluations, synthetic testing, and model comparisons.
- Diagnose hallucinations, retrieval mismatches, tool-use errors, and unexpected agent behavior, then implement guardrails and workflow corrections.
- Integrate AI components with vector databases, graph databases, internal applications, and infrastructure tools.
- Document model usage, agent behavior, experiments, workflow designs, and best practices.
- Collaborate with cybersecurity and governance teams to meet AI policies and safe-use requirements.
Requirements
- Active Top Secret clearance and U.S. citizenship are required.
- Bachelor's degree is required, or nine years of relevant experience may substitute for the degree.
- At least five years of related experience is required.
- Experience tuning, evaluating, and validating AI workflows, including prompts, agent configurations, tool calling, and retrieval strategies.
- Experience designing structured AI behavior tests and diagnosing failures such as hallucinations, retrieval issues, and tool-use errors.
- Proficiency in Python and familiarity with AWS Bedrock services are required.
- Familiarity with JavaScript or other programming languages is beneficial.
- Experience with data modeling, AI agents and workflow integration, AI prompting, Python software development, AWS AI services, and AI architecture.
- Experience with observability tools, including logging, metrics, and traces, is required.
- Comfort with CI/CD and Git-based development workflows.
- Strong written and verbal communication, independent work ability, and client relationship skills.
- A master's degree in computer science is preferred.
Benefits
- Medical, dental, vision, 401(k), short-term disability, long-term disability, life insurance, paid time off, and paid holidays are offered.
- The role is 100% onsite in Washington, DC.
- No third-party vendors are accepted.