Alvys

QA Automation Engineer

Alvys
Apply
2 days ago
Remote, ColombiaMid Level / Senior

Responsibilities

  • Architect automation and quality infrastructure strategy, including Playwright-based frameworks adopted by engineers across the organization.
  • Own the CI/CD quality pipeline, including sharding, parallelization, flake SLOs, artifact collection, post-deployment monitoring, and test-health dashboards.
  • Define test strategy, standards, coverage targets, risk-based prioritization, test data, and environment isolation for complex software systems.
  • Apply contract testing, performance testing, synthetic monitoring, and chaos engineering based on product risk.
  • Run agent-based test development and triage loops, and build evaluation and regression frameworks for AI-powered features.
  • Improve release processes and quality gates, lead post-incident quality reviews, and automate systemic fixes.
  • Represent quality in architecture and product decisions while collaborating with engineering, product, platform, and customer success teams.

Requirements

  • 4–7 years of industry experience in software or test engineering.
  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • Strong experience designing and building Playwright-based test automation frameworks adopted by other engineers.
  • Experience owning CI/CD quality pipelines, including parallelization, flake management, and post-deployment monitoring.
  • Experience defining test strategy for complex software systems using risk-based prioritization and measurable quality metrics.
  • AI proficiency involving specifications with acceptance checks, evidence-based review of agent results, and maintaining task state outside the context window.
  • Strong analytical and problem-solving skills with a focus on software quality.
  • Preferred experience running parallel agent loops with harnesses, using evals in CI, and building reusable checks from past failures.
  • Preferred experience building evaluation and regression frameworks for AI-powered features or non-deterministic outputs.
  • Preferred experience with contract testing, synthetic monitoring, chaos engineering, and performance or load testing tools.
  • Preferred experience mentoring test engineers and driving quality practices across multiple teams.
  • Knowledge of bug-tracking and test-management tools such as Jira, Azure DevOps, or TestRail.

Benefits

  • Remote role, indicated by the #LI-Remote posting tag.
  • Equal opportunity employer with accommodations available during the recruitment process.

Categories

Alvys

About Alvys

51-200 employees

Alvys builds a cloud-based transportation management system used by trucking carriers and freight brokers to run dispatch, accounting, EDI, and driver workflows. The company sells its multi-tenant SaaS platform by subscription and integrates with load boards, telematics, and accounting tools. Privately held and headquartered in Solana Beach, California, Alvys reports adoption by over 1,000 fleets in the U.S.

Contact me