Senior Software Developer in Test (AI Portfolio)
Vena Solutions4 days ago
Remote, CanadaSenior
Responsibilities
- Analyze requirements and define comprehensive test strategies and automation needs.
- Design, write, maintain, and manage automated UI and API test suites.
- Build and enhance scalable automation frameworks using tools such as Playwright and Rest-Assured.
- Plan and execute exploratory, functional, integration, performance, regression, and AI product testing.
- Validate AI model accuracy, output consistency, performance, edge cases, prompts, bias, and model boundaries.
- Integrate AI tools and LLM APIs into testing workflows and CI/CD pipelines.
- Monitor, troubleshoot, and optimize automation pipelines and test frameworks for stability, scalability, and dependability.
- Perform root cause analysis and support defect prevention.
- Collaborate with development and product teams to improve requirements, test coverage, test data management, and code quality.
Requirements
- At least 5 years of experience in QA/QE and test automation development roles.
- Proven experience testing AI/ML products, including prompt evaluation, bias detection, or model boundary testing.
- Hands-on experience integrating AI tools or LLM APIs into CI/CD pipelines.
- At least 3 years of hands-on experience with an automation framework supporting both UI and API testing.
- Experience with one or more of Playwright, Cypress, Selenium, Rest-Assured, RestSharp, or Pytest.
- Experience with version control, issue tracking, and test case management tools such as GitHub, GitLab, JIRA, Xray, Zephyr, or Qase.
- Proficiency with relational databases and data validation using SQL, MS SQL, Oracle, GraphQL, or DB2.
- Proficiency in one or more of Java, JavaScript, TypeScript, C#, or Python.
- Strong understanding of software testing methodologies, automation design patterns, and test case development.
- Ability to assess system architecture and the impact of product changes across components.
- Strong troubleshooting, analytical, problem-solving, written communication, and verbal communication skills.
- Interest in AI and willingness to explore AI-driven solutions.
Tech Stack
Categories
About Vena Solutions
Vena Solutions builds a cloud FP&A and corporate performance management platform that enables finance teams to plan, budget, and report in Microsoft Excel with centralized data, workflow, and controls. Delivered as SaaS, it integrates with Microsoft 365 and Power BI and supports budgeting, forecasting, and month-end close. The company is privately held and headquartered in Toronto, serving finance and accounting teams at mid‑market and enterprise organizations.