Principal QE Engineer/Architect - Automation Testing (10+ Years)- 11936
Coupa Software15 days ago
Pune, IndiaStaff+
Responsibilities
- Design and architect custom test automation frameworks and evaluation pipelines for AI models and AI-native applications.
- Build proprietary AI testing tools such as synthetic data generators, LLM evaluation harnesses, prompt regression suites, and self-healing test automation engines.
- Establish cross-department AI testing standards, quality practices, AI safety gates, and quality gates.
- Lead enterprise-scale architectural initiatives and resolve complex technical bottlenecks.
- Evaluate AI hallucinations, model drift, bias, output accuracy, and other quality risks.
- Advise executive leadership, define organizational goals and ROI benchmarks, and mentor senior engineers.
- Lead cross-functional stakeholder initiatives and represent the company at external AI and quality engineering forums.
Requirements
- At least 10 years of experience as a Principal Engineer or Architect.
- Recent 2-4 years of experience building AI tooling, agentic testing frameworks, evaluation pipelines, real-time production data feedback loops, and data quality standards.
- Proven technical architectural leadership experience for complex enterprise platforms.
- Advanced programming fluency and experience connecting non-deterministic AI outputs with deterministic enterprise systems.
- Hands-on experience shipping LLM-powered features and building custom test frameworks, model evaluation harnesses, or automated testing tools.
- Familiarity with or hands-on experience using open-standard agentic architectures such as LangChain, AutoGen, or MCP.
- Strong problem-solving, analytical, debugging, stakeholder-management, and technical leadership skills.
- Experience leading cross-functional teams and managing executive-level and cross-region stakeholders.
Benefits
- Two company-wide paid wellness days each year.
- Paid birthday time off.
- 40 hours of paid volunteer time off annually.
- Free confidential 24/7/365 Employee Assistance Program resources.
- Business travel protection through Zurich Travel Assist.
- Referral bonus program.
- Location-specific benefits packages may include medical and dental insurance, retirement or pension plans, and life or accident protection.
Categories
About Coupa Software
Coupa Software provides a cloud-based spend management platform used by enterprises to manage procurement, sourcing, invoicing, and supplier interactions. It sells SaaS subscriptions and services that help finance and operations teams control and analyze business spending across a large buyer–supplier network. Founded in 2006 and headquartered in Foster City, California, Coupa is privately held under Thoma Bravo ownership and serves global customers across many industries.