AI Automation Quality Engineer
Harvard University1 day ago
Cambridge, MA, USAMid Level
Responsibilities
- Design and implement AI agents that generate comprehensive functional, integration, regression, accessibility, and API test scenarios from requirements and documentation.
- Build code-aware agents that analyze Django, FastAPI, and frontend codebases to identify impacted components and generate reusable test cases.
- Develop RAG pipelines using Jira, Confluence, Git repositories, test suites, architecture documentation, API specifications, and historical defects.
- Implement human-in-the-loop workflows for Business Analyst and Product Owner review before automated test code is produced.
- Generate and validate automated tests using Playwright, Selenium, pytest, or equivalent frameworks, and prepare commits or pull requests.
- Maintain regression suites, API tests, UI automation, performance validation, and CI/CD integration.
- Use review feedback, production defects, and failed test patterns to improve prompts, retrieval strategies, testing patterns, and agent performance.
- Collaborate with developers, architects, Business Analysts, product owners, and DevOps engineers on AI-driven quality engineering standards and governance.
Requirements
- Minimum of two years of post-secondary education or relevant work experience.
- At least 3 years of experience building automated test frameworks for enterprise web applications.
- Experience using AI coding assistants in a real testing workflow, including generating, maintaining, or reviewing tests.
- Strong Python development experience.
- Experience with Playwright, Selenium, Cypress, pytest, or similar test automation frameworks.
- Experience using Jira and Agile development processes.
- Understanding of Git workflows, CI/CD pipelines, SDLC, and STLC.
- Ability to translate business requirements into automated quality strategies and demonstrate strong analytical thinking.
- Preferred experience developing AI agents that generate code or software tests.
- Preferred experience testing Django and/or FastAPI applications, measuring test coverage, or working in higher education or enterprise ERP/student information systems.
- Completion of Harvard IT Academy foundational courses or an external equivalent is preferred.
Benefits
- Fully benefited, full-time Harvard University position funded through June 30, 2027, with possible renewal contingent on performance and continued funding.
- Hybrid work arrangement with onsite work as needed and advance notice; schedule and location are determined by department operational needs, subject to Harvard work-location requirements.
- 180-day orientation and review period.
- Generous paid time off, including parental leave.
- Medical, dental, and vision insurance coverage starting on day one.
- Retirement plans with university contributions, wellbeing and mental health resources, family and caregiver support, professional development and tuition assistance, commuter benefits, discounts, and campus perks.
Categories
About Harvard University
Harvard University is a private research university that provides undergraduate, graduate, and professional education and conducts research across disciplines. Revenue from tuition, executive and online programs, research grants, and its endowment funds its schools and institutes, including Harvard Medical School and the Division of Medical Sciences. Founded in 1636 and headquartered in Cambridge, Massachusetts, it operates campus and enterprise IT systems supporting teaching, research, and administration.