
QA Engineer | Barcelona
TransPerfect8 days ago
Barcelona, SpainMid Level
Responsibilities
- Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications.
- Build and improve maintainable test automation frameworks using Playwright, Selenium, or comparable tools.
- Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide release-quality feedback.
- Create risk-based test strategies, test plans, scenarios, and traceable test cases aligned with user stories and acceptance criteria.
- Perform exploratory, cross-browser, system, end-to-end, database, and RESTful API testing.
- Validate data integrity, access control, error handling, usability, compatibility, and backend behavior.
- Document, prioritize, and track defects in Azure DevOps or comparable tools with clear technical evidence.
- Collaborate with developers, product managers, QA leads, and release managers on risks, defects, and release readiness.
- Test AI-powered and LLM-based workflows for functional correctness, output quality, reliability, and requirements alignment.
- Evaluate AI-generated language and translation outputs for meaning preservation, terminology, fluency, formatting, and locale conventions.
- Create repeatable AI test scenarios and evaluation datasets for normal, edge, ambiguous, multilingual, and adversarial inputs.
- Identify AI-specific failures such as hallucinations, omissions, inconsistency, bias, unsafe outputs, and instruction-following failures.
- Use approved AI assistants for test design, data preparation, automation, debugging, and reporting while independently validating generated artifacts.
- Maintain test assets and documentation, recommend improvements, and communicate test progress, risks, defects, and blockers across distributed teams.
Requirements
- Bachelor’s degree in Computer Science, Engineering, a related discipline, or equivalent relevant experience.
- Professional software quality engineering experience combining manual and automated testing.
- Hands-on experience developing and maintaining UI or API automation with Playwright, Selenium, or similar frameworks.
- Programming proficiency in C#, Java, or a comparable test-automation language.
- Experience with RESTful API testing, debugging, test-data management, and backend validation.
- Experience with CI/CD platforms and defect or test management tools such as Azure DevOps, TeamCity, or Jira.
- Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results.
- Familiarity with AI-assisted coding or testing tools and the ability to review and validate generated code, test cases, and results.
- Foundational understanding of LLM capabilities and limitations, including hallucinations and variable outputs.
- Strong analytical, troubleshooting, documentation, communication, independent-working, and collaboration skills.
- Preferred experience with AI/LLM applications, machine translation, retrieval-augmented generation, generative AI, automated AI evaluations, quality rubrics, curated datasets, or regression benchmarks.
- Preferred knowledge of AI security and safety scenarios such as prompt injection, data leakage, and inappropriate output handling.
- Preferred experience with .NET, SQL/database validation, performance or load testing, service virtualization, or agent-based QA workflows.
- Professional working knowledge of an additional language and ability to work across time zones and understand complex business workflows.
Benefits
- Significant ownership within a dynamic QA team in a technology division.
- Collaboration with distributed product, development, and release teams.
- Hands-on exposure to AI-enabled products, LLM evaluation, and AI-assisted testing workflows.
- Opportunities to expand skills in automation frameworks, API testing, CI/CD, and responsible AI quality practices.
About TransPerfect
TransPerfect provides language services and localization technology to enterprises, including translation, interpretation, software and multimedia localization, and AI-enabled workflow automation via its GlobalLink platform. It sells B2B services and SaaS that streamline multilingual content, compliance, and customer support across channels, with specialized practices in gaming, legal, and life sciences. Founded in 1992 and headquartered in New York, the privately held company operates offices worldwide and supports content in more than 200 languages.