Software Mind

[8CI] QA AUTOMATION ENGINEER / SDET — AI PROTOTYPING

Software Mind
Apply
7 hours ago
Remote, Costa Rica +2 moreSenior

Responsibilities

  • Define and run a risk-based test strategy across several prototypes.
  • Build reusable automated checks for APIs, user interfaces, generated documents, and AI-generated output.
  • Integrate automated tests into CI pipelines and maintain fixtures and test data.
  • Maintain versioned golden datasets with the Product Owner and client engineers.
  • Design deterministic checks, schema validation, bounded acceptance criteria, and regression tracking for AI output.
  • Use AI-assisted test generation while reviewing and owning every generated test.
  • Extend regression suites after defects or feature changes and run them before refactoring.
  • Report coverage, known limitations, and release risk while supporting developers with shared fixtures and tooling.

Requirements

  • At least 5 years of experience in QA automation or as an SDET.
  • Strong test automation experience with TypeScript and/or Python.
  • Experience with API and integration testing and Playwright or a similar UI automation tool.
  • Experience integrating automated tests into CI pipelines and managing fixtures and test data.
  • Practical experience using AI tools to generate tests with critical review of their output.
  • Risk-based judgment about testing priorities in prototype environments.
  • Good English and availability during core hours on US Central Time.
  • Preferred experience evaluating LLM or other AI output, including evaluation sets, scoring, and regression.
  • Preferred experience testing PDFs, spreadsheets, or generated reports.
  • Exposure to engineering, construction, or CAD/BIM data is advantageous.
  • Experience with AWS-hosted applications is advantageous.
  • Familiarity with engineering codes or regulated, safety-relevant domains is advantageous.

Benefits

  • Six-month engagement.
  • Core working hours are aligned with US Central Time.
  • Work is part of a six-person squad building AI tools for a commercial electrical systems SaaS company.

Categories

Software Mind

About Software Mind

1,001-5,000 employees

Software Mind provides outsourced software engineering and autonomous, cross-functional development teams to startups through enterprises, delivering custom applications, cloud, AI, data and embedded solutions. The privately held company, headquartered in Krakow, operates across Europe, the US and LATAM, supporting full software lifecycles from ideation to maintenance. It offers nearshore/offshore engagement models and received private equity investment in 2020.

Contact me