about 5 hours ago
Toronto, Canada +3 moreMid Level / Senior
H1B Sponsor
Responsibilities
- Build and maintain agent skills and the infrastructure for validation and evaluation.
- Design evaluation datasets and workflows to compare agent behavior against baselines.
- Create metrics and observability for agent performance, including success rates and tool usage.
- Establish safety and quality gates for agent-authored content.
- Develop command-line tools, libraries, and CI integrations.
- Investigate failures and implement reusable improvements.
- Collaborate with engineers and product teams to communicate technical trade-offs.
Requirements
- 2+ years of experience in building production software or developer tools.
- Strong fundamentals in API design, testing, and maintainability.
- Experience with CLIs, libraries, and CI/CD workflows.
- Ability to design reliable systems for developers.
- Experience reasoning about correctness and safety with ambiguous inputs.
- Strong written and verbal communication skills.
Benefits
- Equity and participation in the employee stock purchase program.
- Flexible paid time off.
- 20 weeks fully-paid gender-neutral parental leave.
- Fertility and adoption assistance.
- Registered Retirement Savings Plan (RRSP) with employer match.
- Mental health counseling and backup child and elder care.
- Health, dental, and vision benefits offerings.