AI QA Engineer
Pure Storage2 months ago
Prague, CzechiaMid Level
Responsibilities
- Design and run quality strategies for AI-driven features, including evaluation datasets, regression suites, quality metrics, and validation of non-deterministic outputs.
- Create and maintain automated tests across unit, integration, and end-to-end testing layers.
- Validate AI and platform behavior for accuracy, latency, cost, functional correctness, drift, hallucinations, and guardrail effectiveness.
- Collaborate with engineering teams and stakeholders to take solutions from initial design through production.
- Contribute to code reviews, documentation, continuous integration, continuous deployment, and quality engineering best practices.
- Experiment with new technologies and AI-assisted approaches to improve automation and engineering efficiency.
- Share testing expertise and quality practices to support continuous improvement.
Requirements
- Experience designing, implementing, testing, and operating software applications or platform components.
- Proficiency in Python, Java, Go, or another modern programming language.
- Exposure to testing AI or ML-backed features, such as evaluation harnesses, prompt and model regression testing, or output-quality measurement; direct experience is a plus but not required.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud, including Kubernetes.
- Experience with SQL and NoSQL databases, data structures, algorithms, and modern software engineering practices.
- Familiarity with AI-assisted QA automation and cloud networking concepts.
- Interest in quality challenges specific to AI systems, including non-determinism, drift, hallucination, and guardrail verification.
- Strong collaboration, communication, and problem-solving skills.
Benefits
- Primarily in-office work from the Prague office, subject to company policies.
- Flexible time off, wellness resources, and company-sponsored team events.
- Growth support, inclusive workplace initiatives, and employee resource groups.
- Accessibility accommodations are available throughout the hiring process.
About Pure Storage
Pure Storage builds all-flash data storage systems and software for enterprises, including FlashArray and FlashBlade, and offers storage delivered as-a-service for on‑prem and cloud workloads. Its subscription model (Evergreen/Pure as‑a‑Service) supports databases, virtualization, analytics, and AI. Founded in 2009 and headquartered in Santa Clara, California, Pure is a public company listed on the NYSE (PSTG).