Runlayer

Senior QA Engineer, Agent Security

Runlayer
Apply
4 hours ago
Remote, United StatesSenior

Responsibilities

  • Own release testing and overall quality for Runlayer Endpoint.
  • Build and operate physical and virtual device labs.
  • Design cross-platform test strategies covering configurations, clients, and product states.
  • Automate installation, enrollment, configuration, upgrade, rollback, and removal flows.
  • Test deployments through enterprise device-management platforms and validate AI coding client integrations.
  • Build agent-driven tooling to expand coverage, collect evidence, and accelerate failure analysis.
  • Integrate automated quality signals into CI and release workflows.
  • Reproduce customer issues and convert confirmed incidents into permanent regression tests.
  • Partner with engineers to improve diagnostics, observability, and testability.
  • Define testability and coverage standards for platforms, clients, and features.

Requirements

  • Senior-level experience owning QA automation or test infrastructure.
  • Strong engineering skills in Python and system scripting such as Bash and PowerShell.
  • Hands-on experience testing software across macOS, Windows, and Linux.
  • Experience with endpoint management, MDM, device labs, or comparable fleet orchestration.
  • Experience testing native installation, upgrades, background services, permissions, credentials, and operating-system configuration.
  • Strong knowledge of integration, end-to-end, stateful, and combinatorial testing.
  • Ability to distinguish product defects from infrastructure failures and flaky tests.
  • Experience building reliable CI-driven systems with useful diagnostics and test artifacts.
  • Clear technical judgment and excellent bug reporting.
  • Bonus experience with Intune, Jamf Pro, Kandji, SimpleMDM, Mosyle, Workspace ONE, endpoint-security or fleet-management products, MCP, AI coding clients, AI-agent testing tools, native packaging and signing, fault injection, change-impact analysis, or combinatorial test generation.

Benefits

  • Competitive salary and equity are offered, with compensation reflecting expertise and customer-facing responsibilities.
  • Paid vacation, sick leave, and parental leave are provided.
  • Professional development budget is available for conferences, courses, and certifications.
  • Employees can choose their laptop and accessories.
  • Comprehensive health, dental, and vision coverage is provided.
  • The role includes opportunities to interact directly with enterprise customers.

Tech Stack

BashLinuxmacOSPowerShellPythonWindows

Categories

Runlayer

About Runlayer

11-50 employees

Give every employee the golden path to use agents, then watch adoption multiply. AI enablement and control in one platform. The default for AI-native teams like Instacart, Gusto, Lemonade, dbt Labs, and AngelList. Backed by Khosla and Felicis. Based in NYC & SF.