12 months ago
India (city not specified)Staff+
Responsibilities
- Define the overall QA strategy and architect large-scale, reusable, cross-platform automation frameworks.
- Own the AI vertical’s quality charter and drive organization-wide quality initiatives.
- Design scalable testing approaches for RAG, hallucination, model drift, and bias.
- Own decisions regarding test strategy, tools, frameworks, and AI testing methodologies.
- Coach and upskill the team, establish best practices, and build a talent pipeline.
- Influence cross-functional teams, participate in architecture discussions, and align testing with business strategy.
- Lead end-to-end product- or vertical-level quality strategy and shape the AI quality roadmap.
- Reduce organization-wide risk and improve scalability and reliability.
Requirements
- 7+ years of overall experience in QA/SDET roles.
- Deep expertise in AI tools and model testing, including RAG, hallucination, drift, and bias testing.
- Experience architecting large-scale, reusable, cross-platform automation frameworks.
- Strong leadership skills for coaching and upskilling a team, setting best practices, and building a talent pipeline.
- Ability to influence cross-functional teams and participate in architecture discussions.
- Strong problem-solving skills and ownership of test strategy, tools, frameworks, and AI testing methodologies.
- Bonus: experience with CI/CD pipelines and cloud platforms such as AWS, GCP, or Azure.
- Bonus: familiarity with MLOps pipelines and monitoring AI systems.
- Bonus: exposure to performance and scalability testing of AI workloads.
Benefits
- Remote-first organization operating across 10+ countries.
- Equal Opportunity Employer; demographic information requested for compliance purposes is voluntary and separate from hiring decisions.
Tech Stack
Categories
About HighLevel
HighLevel builds a white-label, all-in-one marketing and CRM platform for agencies, entrepreneurs, and SMBs, combining lead capture, automation, email/SMS, websites and funnels, payments, and appointment management. Founded in 2018 and headquartered in Dallas, it is privately held and raised $60M in private equity funding in 2024. The subscription SaaS serves customers in 150+ countries and is used by over one million businesses.