AI Automation Quality Engineer
Harvard University6 days ago
Cambridge, MA, USAMid Level
Responsibilities
- Design AI agents that generate functional, integration, regression, accessibility, and API test scenarios from requirements and technical documentation.
- Build code-aware agents that analyze Django, FastAPI, and frontend codebases to identify impacted components and generate reusable test cases.
- Develop RAG pipelines using Jira, Confluence, Git repositories, test suites, architecture documentation, API specifications, and historical defects.
- Implement human-in-the-loop workflows for reviewing and validating generated test scenarios before automation code is produced.
- Generate and maintain automated tests with Playwright, Selenium, pytest, Cypress, or equivalent frameworks.
- Maintain regression suites, API tests, UI automation, performance validation, and CI/CD integration.
- Capture review feedback, production defects, and failed test patterns to improve prompts, retrieval strategies, testing patterns, and agent performance.
- Collaborate with Business Analysts, developers, architects, product owners, and DevOps engineers on AI-driven quality engineering standards and governance.
Requirements
- At least two years of post-secondary education or relevant work experience.
- At least three years of experience building automated test frameworks for enterprise web applications.
- Experience using AI coding assistants in real testing workflows and ability to explain their successes and limitations.
- Strong Python development experience.
- Experience with Playwright, Selenium, Cypress, pytest, or similar test automation frameworks.
- Experience using Jira and Agile development processes.
- Understanding of Git workflows and CI/CD pipelines.
- Knowledge of software development and software testing life cycles.
- Ability to translate business requirements into automated quality strategies and demonstrate strong analytical thinking.
- Preferred experience developing AI agents that generate code or software tests.
- Preferred experience testing Django and/or FastAPI applications, measuring test coverage, or working in higher education or enterprise ERP/student information systems.
- Completion of Harvard IT Academy foundational courses or an external equivalent is preferred.
- Preferred cross-functional collaboration, continuous improvement, adaptability to emerging AI and testing technologies, team performance, and trusted-advisor skills.
Benefits
- Fully remote work arrangement from a Harvard-registered state, with occasional on-site work potentially required.
- Full-time, fully benefited Harvard University position funded through June 30, 2027, with possible renewal based on performance and continued funding.
- Generous paid time off, including parental leave.
- Medical, dental, and vision insurance beginning on day one.
- Retirement plans with university contributions.
- Wellbeing and mental health resources.
- Family and caregiver support.
- Professional development opportunities, including tuition assistance and reimbursement.
- Commuter benefits, discounts, and campus perks.
- The position has a 180-day orientation and review period.