Soft Tech Consulting

AI Mid Software Engineer

Soft Tech Consulting
Apply
12 days ago
Washington, DC, USAMid Level

Base Salary

$120k - $165k/yr

Responsibilities

  • Design, build, and optimize agentic AI systems with LangGraph, CrewAI, Google ADK, or AWS Bedrock AgentCore.
  • Implement multi-step, tool-enabled workflows integrating LLM reasoning, retrieval-augmented generation, external APIs, and enterprise tools.
  • Use foundation models on Amazon Bedrock for structured generation, extraction, summarization, planning, and decision support.
  • Tune prompts, agent configurations, instructions, retrieval strategies, and tool-use behavior.
  • Conduct regression tests, scenario-based evaluations, synthetic testing, and model comparisons.
  • Diagnose hallucinations, retrieval mismatches, tool-use errors, and unexpected agent behavior, then implement guardrails and workflow corrections.
  • Integrate AI components with vector databases, graph databases, internal applications, and infrastructure tools.
  • Document model usage, agent behavior, experiments, workflow designs, and best practices.
  • Collaborate with cybersecurity and governance teams to meet AI policies and safe-use requirements.

Requirements

  • Active Top Secret clearance and U.S. citizenship are required.
  • Bachelor's degree is required, or nine years of relevant experience may substitute for the degree.
  • At least five years of related experience is required.
  • Experience tuning, evaluating, and validating AI workflows, including prompts, agent configurations, tool calling, and retrieval strategies.
  • Experience designing structured AI behavior tests and diagnosing failures such as hallucinations, retrieval issues, and tool-use errors.
  • Proficiency in Python and familiarity with AWS Bedrock services are required.
  • Familiarity with JavaScript or other programming languages is beneficial.
  • Experience with data modeling, AI agents and workflow integration, AI prompting, Python software development, AWS AI services, and AI architecture.
  • Experience with observability tools, including logging, metrics, and traces, is required.
  • Comfort with CI/CD and Git-based development workflows.
  • Strong written and verbal communication, independent work ability, and client relationship skills.
  • A master's degree in computer science is preferred.

Benefits

  • Medical, dental, vision, 401(k), short-term disability, long-term disability, life insurance, paid time off, and paid holidays are offered.
  • The role is 100% onsite in Washington, DC.
  • No third-party vendors are accepted.
Soft Tech Consulting

About Soft Tech Consulting

51-200 employees
Contact me