3 hours ago
Remote, CanadaSenior
Responsibilities
- Build and improve reliable, trackable background-agent infrastructure for automated engineering work.
- Develop agent-performance evaluation systems using task outcomes, quality measures, human intervention, cost, and other signals.
- Create evaluation sets and feedback loops for continuous AI-system improvement.
- Improve the discovery, adoption, and usability of shared AI tools and engineering workflows.
- Evaluate and integrate code-generation, AI-assisted review, testing, and other AI development tools.
- Develop visibility into tool and workflow effectiveness, friction, and evolution.
- Improve code-review workflows using feedback from real engineering work.
- Contribute to the foundations of an autonomous software factory and systems that help agents safely complete bounded engineering tasks.
- Work with engineers and internal users to understand needs, validate solutions, and make product tradeoffs.
- Move ambiguous, dependency-heavy projects from exploration through reliable delivery.
- Contribute to code reviews, technical design discussions, testing, observability, reliability, and security.
- Partner with engineers and cross-functional stakeholders as a collaborative technical contributor.
Requirements
- Substantial industry software engineering experience.
- Experience taking technical leadership roles on teams or complex projects.
- Experience improving AI systems, creating evaluation sets, and driving quality improvement through measurement and iteration.
- Strong software engineering fundamentals and experience designing, building, testing, and operating reliable systems.
- Experience with developer tooling, AI-enabled workflows, agentic systems, infrastructure, or related technical domains.
- Track record of working through ambiguity, decomposing complex problems, managing dependencies, and completing projects.
- Experience in rapidly scaling startups or larger companies, particularly in action-oriented environments.
- Hands-on, action-oriented approach with willingness to engage directly with users.
- Strong product judgment, curiosity, written and verbal communication, and ability to explain technical concepts clearly.
- Collaborative approach and demonstrated ability to contribute meaningfully as part of a team.
- Uses AI in day-to-day work, experiments to build fluency, and applies sound judgment to maintain a high quality bar.
Benefits
- 100% covered medical, dental, and vision benefits with dependent coverage.
- Pension contribution.
- 16 weeks of paid parental leave for all new parents.
- Health and wellness stipend.
- Remote workspace, internet, and cellphone stipend.
- Flexible work hours and location; remote role in Canada.
- 21 vacation days, 80 hours of sick leave, and 11 company-paid holidays.
- Virtual team-building activities, lunch-and-learns, and company-wide events.
- Industry-competitive salary and equity.
Categories
About Vanta
Vanta builds a SaaS platform that automates security and compliance for companies, including SOC 2, ISO 27001, HIPAA, PCI, and GDPR, plus risk, vendor, and audit management. It sells subscriptions to startups through enterprises, integrating with cloud and workplace tools to monitor controls and publish a public Trust Center. Founded in 2018 and headquartered in San Francisco, it serves 15,000+ customers in 58 countries and has offices in Dublin, London, New York, and Sydney.