1 day ago
Rockville, MD, USA or Reston, VA, USAMid Level / Senior
Base Salary
$99k - $168k/yr
Responsibilities
- Design and build LLM pipelines and agents for survey reporting, natural-language data analysis, questionnaire translation, and interviewer or supervisor field support.
- Build evaluation harnesses, expert-grounded test sets, automated and human grading processes, regression tests, and ship/no-ship decision workflows.
- Route workloads across models and manage inference costs using token usage, context limits, prompt caching, batch processing, latency, volume, and data-residency considerations.
- Connect models to data services and full-stack applications, and use agentic coding tools to produce, review, test, and own production code.
- Monitor production systems, conduct error analysis, report positive and negative results, and document methods and results for public release.
- Transfer tools to partner-country institutions so they can operate them independently.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent years of experience.
- At least 4 years of professional software development experience, including production LLM-powered systems relied on by real users.
- U.S. citizenship is required for the federal government contract.
- Proficiency in Python or another modern programming language such as JavaScript, TypeScript, or Go for backend and AI application development.
- Hands-on experience with frontier-model APIs, tool use, and retrieval-augmented generation.
- Experience designing LLM evaluations, including test-set construction, automated and human grading, regression testing, and ship/no-ship decisions.
- Working knowledge of LLM cost, latency, and model-selection trade-offs.
- Experience building and deploying on a major cloud platform such as AWS, Azure, or Google Cloud.
- Experience using agentic coding tools such as Claude Code, OpenAI Codex, Cursor, Antigravity, or GitHub Copilot agent mode.
- Experience with agent frameworks and AI evaluation tooling.
- Preferred experience includes expert-grounded systems, structured or tabular data, multilingual or low-resource-language NLP, open-weight models, sensitive or regulated data, model governance, global health, and public technical work.
Benefits
- Remote within the United States with occasional travel.
- Full-time position contingent upon award of program funding.
- Equal opportunity employer with reasonable accommodations available for disability, religious, and veteran-related needs.
Tech Stack
Categories
About ICF
ICF is a global consulting and technology services firm serving government and commercial clients across domains such as energy, health, climate, and digital modernization. It delivers advisory, program implementation, analytics, and software-enabled solutions on platforms like ServiceNow. Founded in 1969 and headquartered in Reston, Virginia, ICF is a public company traded on NASDAQ and works extensively with U.S. federal, state and local agencies as well as regulated industries.