17 days ago
Remote, United States or Atlanta, GA, USASenior
Responsibilities
- Develop test plans, test cases, acceptance criteria, traceability matrices, defect reports, and quality assessments for AI-powered clinical summarization.
- Design testing across CCDs, Discharge Summaries, Progress Notes, History & Physical documents, APIs, user interfaces, CDS workflows, and multiple patient data sources.
- Validate C-CDA XML structure, clinical entries, data extraction, AI-generated summaries, source traceability, guardrails, monitoring, auditability, and quality controls.
- Perform functional, integration, system, regression, performance, and user acceptance testing, including positive, negative, boundary, and edge-case scenarios.
- Develop and maintain automated test suites and validation frameworks for document ingestion, AI summarization, APIs, and user interfaces.
- Support CI/CD quality gates, continuous testing, defect triage, root-cause analysis, and release-readiness activities.
- Evaluate AI-generated content for omissions, inaccuracies, hallucinations, completeness, consistency, usability, accuracy, and reliability.
- Collaborate with software engineers, solution architects, clinicians, product owners, cybersecurity teams, and government stakeholders.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, Health Informatics, Engineering, or a related technical discipline, or equivalent experience.
- At least 5 years of experience testing healthcare software applications.
- Strong knowledge of C-CDA standards and experience reading, validating, and troubleshooting XML-based healthcare data.
- Experience with healthcare interoperability, clinical data exchange, Clinical Decision Support applications, and CDS workflows.
- Familiarity with SMART on FHIR, CDS Hooks, REST APIs, test automation frameworks, API testing tools, and defect management platforms.
- Experience developing and maintaining automated testing solutions in Agile and DevSecOps environments.
- Experience with AI-assisted testing, generative AI, LLMs, AI-generated test scripts, validation frameworks, test data, and output-quality evaluation.
- Additional qualifications include VA healthcare systems experience, USCDI knowledge, SNOMED CT, LOINC, RxNorm, ICD, AI/ML healthcare solution validation, autonomous AI testing workflows, prompt engineering, accessibility and usability testing, and cloud-native development experience.
- Experience with AI-powered testing platforms such as GitHub Copilot, Microsoft Copilot, Testim, Functionize, or Mabl is preferred.
- Strong analytical, troubleshooting, problem-solving, written communication, and verbal communication skills.
- U.S. citizenship is required, along with successful completion of a background check and the ability to obtain and maintain a Government/Public Trust clearance when required.
Benefits
- Medical, dental, and vision insurance.
- 401(k) with employer match.
- Paid time off and federal holidays.
- Corporate laptop.
- Training opportunities.
- 100% remote position; candidates must reside within the continental United States.
Categories
