5 hours ago
Remote, United StatesStaff+
Base Salary
$165k - $195k/yr
Responsibilities
- Translate business requirements and problem statements into prompts for AI Foundry platforms and ecosystems.
- Assess generated full-stack, AI, and agent-based system code for design gaps, inefficiencies, and coding-standard issues.
- Implement necessary design and code fixes.
- Test, verify, and deploy end-to-end systems and applications.
- Evaluate AI and LLM systems for accuracy, bias, and reliability using testing and evaluation tools.
Requirements
- Ability to obtain and maintain a government-issued Public Trust.
- 20+ years of overall software, distributed-systems, and cloud-native system development experience.
- Knowledge of Google JavaScript and JSON style guides, PEP 8, design patterns including GoF, and architecture frameworks.
- 2–3+ years of experience developing and integrating AI, generative AI, and agentic AI algorithms, models, frameworks, and prompt engineering.
- Knowledge of emerging standards for AI agent ecosystems and expertise with at least one generative AI system such as Gemini, ChatGPT, Claude, or Copilot.
- 5–7+ years of in-depth, hands-on experience with one or more web application frameworks and programming languages, including Angular, React, Python, Node.js, or Rust.
- At least 5 years of hands-on experience with cloud technology stacks, including virtual network architecture, design, implementation, and management; AWS or Google is preferred, with Azure and Oracle also listed.
- At least 1 year of hands-on experience with QA frameworks and test automation platforms.
- Experience testing AI and LLM systems for accuracy, bias, and reliability.
- Hands-on experience with Braintrust and Galileo.
Benefits
- US-remote role with flexible work arrangements.
- Flexible Time Off activated on the first day, paid holidays, and potential time off during the last week of the calendar year when client work permits.
- Health, dental, vision, life, accident, and disability insurance options, plus HSA employer contributions.
- Eleven paid holidays annually and paid parental bonding leave.
- 401(k) with employer contributions, tuition reimbursement, employee and client referral bonuses, and pet insurance.
- Wellness program with opportunities to earn gift cards and other rewards.
- FORCE community volunteer program providing up to four hours of paid volunteer time annually.