4 months ago
Bucharest, RomaniaMid Level
Responsibilities
- Build API and integration test coverage for Java/Spring routers and database workflows.
- Design and implement Playwright end-to-end tests for critical user journeys.
- Create mocking, fixture, and seeded test-data strategies using MSW and related test tooling.
- Set up CI quality gates for linting, unit, integration, end-to-end testing, coverage, and reporting.
- Expand coverage across untested UI and workflow areas and prevent regressions.
- Build LLM evaluation practices with golden datasets and measurable quality gates.
- Track model output reliability, detect drift, and gate releases on quality and stability thresholds.
- Improve test maintainability, reduce flakiness, and optimize test runtime.
- Use LangChain4j, Langfuse, OpenTelemetry, the OpenAI Java SDK, Promptfoo, Jackson, and Swagger annotations for LLM QA, tracing, validation, and regression workflows.
Requirements
- At least 3 years of QA automation experience for production systems.
- Strong Java backend testing and frontend testing skills.
- Experience building and maintaining Playwright, Cypress, or Selenium end-to-end test suites.
- Experience with REST API testing, schema validation, authentication scenarios, and error scenarios.
- Experience with SQL/PostgreSQL testing and test-data management.
- Experience with CI/CD pipelines using GitHub Actions, Azure Pipelines, or Jenkins.
- Practical understanding of testing non-deterministic LLM outputs.
- Preferred experience with Promptfoo, Langfuse, trace-based observability, API/OpenTelemetry integrations, output validation, performance and benchmark testing, WebSocket testing, security and dependency scanning, or legal-tech, fintech, and other regulated domains.
Benefits
- Premium medical package, lunch tickets, and a Pluxee Card.
- Bookster subscription and a 13th salary or yearly bonuses.
- Enterprise job security with a startup mentality, international exposure, flat hierarchy, and a supportive work-life-balance culture.
- Flexible working program with openness to remote work.
- International project opportunities, project flexibility, mentorship, certifications, professional development, and access to Pluralsight, Udemy, Microsoft, and Google Cloud learning platforms.
- Collaborative benefits and internal-practice environment with team events and activities.
Tech Stack
Categories
About Qualysoft
Qualysoft is a Vienna-headquartered IT services firm founded in 1999 that delivers CRM/ERP consulting, custom software development, test automation, integration, and application management for enterprises. It works on a project and managed-services basis across Central and Eastern Europe, supporting digitalization and data/BI initiatives. Privately held, the company serves clients in multiple industries.