Principal Quality Development Engineer
InterSystems17 days ago
Boston, MA, USAStaff+
Base Salary
$115k - $164k/yr
Responsibilities
- Develop and maintain AI validation methodologies and tools for non-deterministic AI-enabled applications.
- Define non-functional and structural testing strategies for application performance, security, interoperability, and LLM validation.
- Evaluate and optimize LLM accuracy, safety, performance, and hallucination detection.
- Lead AI test strategies and detailed release test plans.
- Design and build custom tools for UI, API, and AI/ML validation.
- Support quality development teams with test design, execution, triage, and reporting.
- Provide governance and reporting across AI validation activities.
- Perform system management tasks supporting testing activities and maintain current knowledge of AI developments.
Requirements
- Tertiary qualification in Computer Science or a related discipline.
- At least 3 years of professional experience.
- Comprehensive understanding of AI tools’ capabilities and limitations.
- Good understanding of the software development life cycle and software testing principles.
- Qualifications and/or certifications in AI.
- Technical proficiency in multiple programming languages.
- Experience working with interdisciplinary teams and a collaborative, adaptable approach.
- System administration or DevOps experience is advantageous.
Benefits
- Medical, vision, and dental insurance.
- Short-term and long-term disability and life insurance.
- 401(k) profit-sharing contribution.
- Paid time off and holidays.
- Parental leave.
- Tuition reimbursement.
Categories