7 days ago
Base Salary
$102k - $150k/yr
Responsibilities
- Own GovCloud release quality from test planning and staging validation through regression testing, sign-off, and documentation.
- Design, build, and maintain scalable Playwright automation frameworks using TypeScript and JavaScript.
- Develop and maintain UI, API, integration, and end-to-end automated test suites while reducing test flakiness.
- Convert suitable manual verification cases into repeatable automated tests using page objects, fixtures, reusable utilities, and data-driven testing.
- Integrate automated suites into CI/CD pipelines with parallel execution, reporting, and failure triage.
- Use and validate AI-assisted tools for test design, script creation, refactoring, debugging, failure analysis, and documentation while protecting sensitive GovCloud data.
- Design and execute quality approaches for AI features, including output evaluation, guardrails, prompt regression, edge cases, and GenAI quality tracking.
- Partner with engineering, SRE, GovCloud customer management, and adjacent DXA teams through development and rollout.
Requirements
- At least 5 years of professional experience in backend, integration, and data QA or SDET roles.
- Experience inspecting missing or incorrect session data and converting manual verification checks into automated tests.
- Experience developing Python tools to parse JSON, analyze system logs, compare data outputs, and report failures.
- Experience testing RESTful web services, including systems with multi-step, delayed, or asynchronous data delivery.
- Experience writing automated integration tests with Java and JUnit and managing scheduled CI/CD test executions with Jenkins.
- Experience using AWS services such as S3 for test artifacts and reading cloud logs to debug failures.
- Experience defining release criteria and pass/fail deployment gates.
- Preferred experience with FedRAMP, AWS GovCloud, regulated cloud environments, federal agencies, or public-sector customers.
- Preferred experience with Playwright, JavaScript/TypeScript, AI/ML/LLM feature testing, AI-assisted development tools, Appium, WebdriverIO, Docker, cloud test execution platforms, Allure, contract testing, test data management, BDD, performance testing, accessibility testing, visual regression testing, or security testing tools.
Benefits
- Hybrid schedule with 3 days per week onsite; candidates near Tysons are prioritized.
- Medical, dental, and vision benefits.
- 401(k), short-term and long-term disability, life and AD&D insurance.
- Statutory leaves, paid parental leave, and paid holidays.
- Applications are accepted for 30 days from posting or until the role is filled.
Tech Stack
Apache KafkaAppiumAWSAzureCucumberDockerGitHub ActionsGoogle Cloud PlatformJavaJavaScriptJenkinsJUnitPythonSeleniumSQLTypeScript
Categories
About Medallia
Medallia builds enterprise SaaS for experience management, turning customer, employee, and patient feedback and behavioral signals into insights and actions via Medallia Experience Cloud. The company sells subscriptions and services to large organizations, offering surveys, text analytics, social listening, and workflow integrations. Founded in 2001 and headquartered in McLean, Virginia, Medallia is privately held under Thoma Bravo after being taken private from the NYSE.