3 hours ago
Remote, United StatesSenior
Base Salary
$135k - $170k/yr
Responsibilities
- Own and maintain the functional, integration, performance, and load test plan and translate product acceptance criteria into executable tests.
- Build and maintain automated test suites, regression coverage, and performance/load tests integrated into CI/CD as release gates.
- Review requirements for verifiability, coordinate customer user acceptance testing, and track findings through resolution.
- Create labeled evaluation sets, sampled audits, and measurements of system misses, automated decisions, and user overrides.
- Maintain version inventories, test reports, evaluation records, release evidence, and rollback criteria across builds, models, configurations, and thresholds.
- Verify that test environments sufficiently match production and hold releases until required acceptance evidence exists.
Requirements
- 5+ years of experience in software quality engineering, test automation, or software engineering with substantial dedicated test ownership.
- Strong coding ability with a test automation language and framework, such as Python with pytest or JavaScript/TypeScript with Playwright, Cypress, or Selenium, plus the ability to reason about application code.
- Experience building automated test suites, integrating them into CI/CD release gates, owning test plans, and performing performance and load testing.
- Experience testing against requirements with product owners or end users, measuring system misses, and independently reporting unfavorable results.
- Working statistical literacy in sampling design and measurement confidence, plus clear audit-ready documentation skills.
- Routine use of AI-assisted development and sound judgment about validating AI-generated output.
- Ability to gate work owned by non-reporting teams, hold releases when necessary, and establish testing standards.
- US citizenship, an active US Secret clearance, favorable investigation, and CAC eligibility from the start.
- Willingness to travel up to 25% to customer sites, company headquarters, and vendor facilities.
- Preferred qualifications include active Top Secret clearance; government DevSecOps, RMF, or ATO experience; contract/API testing; test data management; test infrastructure development; AI-assisted testing; JMeter, k6, or Locust; machine-learning output evaluation; model cards; NIST AI RMF; Section 508; and WCAG verification.
Benefits
- Fully remote, results-based work environment.
- 100% employer-paid medical, dental, and vision insurance for the employee and family.
- Unlimited PTO with manager approval.
- Flexible workday and work environment.
- 14 weeks of fully paid parental leave.
- Occasional travel of up to 25% to headquarters, customer sites, and vendor facilities.
Tech Stack
Categories
About DEFCON AI
RESILIENCE IN THE FACE OF DISRUPTION. DEFCON AI is an insights company that leverages artificial intelligence, mathematical optimization, data analytics, and software engineering for resilient optimization of complex systems. In today’s dynamically changing world, DEFCON AI’s technology aligns outcomes with operational goals, better decision making, and empowers customers to anticipate assess, and mitigate the impacts of disruptions.