Responsibilities
- Design and implement comprehensive test strategies for traditional and AI-powered features across the Personal Health Concierge platform.
- Develop and execute test scenarios based on business requirements and acceptance criteria for provider search, facility search, symptom guidance, benefits navigation, cost estimation, claims status, and contact center handoff modules.
- Perform functional, regression, integration, and system testing for web applications and microservices.
- Validate chatbot conversations, AI-generated responses, RAG-based retrieval accuracy, prompt behavior, and healthcare-specific guardrail compliance.
- Conduct API and integration testing for provider directory, benefits and eligibility, claims, cost estimation, AI gateway, and contact center services.
- Collaborate with Product Owners, AI Architects, Developers, and Business SMEs to establish quality engineering practices and drive continuous improvement.
- Use Selenium and Jenkins to streamline testing workflows and increase coverage.
- Perform accessibility testing with JAWS to support accessibility standards compliance.
Requirements
- At least 4 years of quality engineering experience for web applications and microservices, including hands-on testing of AI-enabled applications.
- Experience with Jenkins, Postman, Selenium, Behavior Driven Development, SoapUI, system integration testing, Zephyr, Test Driven Development, and accessibility testing with JAWS.
- Preferred experience with Cucumber, AI validation and conversational testing, healthcare applications, advanced API automation, Avaya contact center integrations, and RAG testing.
- A bachelor's degree in Computer Science, Information Technology, or a closely related discipline is a desired qualification.
- CSQE or ISTQB Advanced Level Test Analyst certification is desired.
- Certification in AI or Machine Learning testing methodologies is preferred.
Tech Stack
Categories
About Brillio
Brillio is The Enterprise AI Accelerator helping Fortune 1000 companies move from AI ambition to scaled impact, faster. Powered by our AI accelerator platform - Agentic Data and Application Management (ADAM), Brillio is one of the fastest-growing digital technology service providers, delivering transformation across five core workstreams: business-led transformation, customer experience transformation, AI and data engineering, digital engineering, and infrastructure engineering. With 14 delivery locations across North America, Europe, and Asia and a team of over 6,000 customer-obsessed professionals, Brillio combines deep industry expertise, modern engineering, and accelerators to deliver measurable outcomes. Brillio accelerates AI by industrializing it across every layer of the business so companies don't just use AI, they operate by it, at reliable enterprise scale.