22 hours ago
Remote, Hungary or Budapest, HungarySenior
Responsibilities
- Design and run test strategies for agentic AI systems, including agents, tools, MCP integrations, and multi-step workflows.
- Build and maintain scalable Python test frameworks and automation with fast CI/CD feedback.
- Develop evaluation datasets, scoring methods, and quality metrics for non-deterministic AI behavior.
- Contribute to cross-team test architecture standards, patterns, and tooling.
- Drive adoption of AI-assisted testing and development workflows.
- Own testing projects from scope and planning through independent delivery.
- Communicate quality risks, test results, and recommendations to developers, product managers, architects, leadership, and other stakeholders.
- Adapt test plans and frameworks as products and AI technologies change.
Requirements
- 5+ years of professional software testing or quality engineering experience with a proven delivery record.
- Strong Python skills and hands-on experience building test frameworks and automation, such as pytest.
- Experience designing test strategies, test plans, and test cases for complex, distributed, or cloud-based systems.
- Experience testing APIs, services, and integrations in CI/CD pipelines.
- Familiarity with LLMs, AI agents, or MCP and strong interest in developing deeper expertise.
- Ability to work independently and manage projects end to end with minimal oversight.
- Excellent communication, analytical, problem-solving, and investigative skills.
- Comfort working in agile teams with frequent change and shifting priorities.
- Preferred experience testing non-deterministic systems, including LLM applications or ML models.
- Preferred experience with AI agent evaluation, eval frameworks, LLM-as-judge, benchmark design, DeepEval, Ragas, or LangSmith.
- Preferred performance, load, or scalability testing experience with Locust, k6, or JMeter.
- Preferred experience contributing to cross-team quality initiatives and using AI-assisted development and testing tools.
- Preferred experience with AWS, containerized environments, contact center, CX, or SaaS platforms.
Benefits
- Flexible work options for Hungary-based candidates, including eventual office-based work in Budapest, long-term remote work, or a hybrid arrangement.
- Extra days off in August and October, additional volunteer time, paid volunteer time, and August Free Fridays.
- Cafeteria, health insurance, life insurance, learning center, language courses, gym, vitamin bar, and company café.
- Career development through mentorship, learning programs, leadership development, and education support.
- Inclusive community, well-being resources, and regionally tailored programs for employees and families.
- Modern headquarters near Nyugati Railway Station in Budapest.
About Genesys
Genesys builds cloud contact center and customer experience software used by enterprises to manage voice and digital interactions, self-service, and workforce engagement. Its Genesys Cloud platform and related tools are sold as subscription services (CCaaS) with AI for routing, automation, and analytics. The company serves more than 8,000 organizations worldwide and is headquartered in Menlo Park, California.