2 days ago
Remote, Canada
Mid Level / Senior
H1B Sponsor
Responsibilities
- Contribute to AI evaluation pipelines, including offline evaluations and feedback systems.
- Implement and maintain performance metrics using established frameworks.
- Create and maintain evaluation datasets and test cases to identify regressions.
- Analyze results and propose improvements to model and agent quality.
- Contribute to AI system components such as RAG pipelines and retrieval systems.
- Write clean, maintainable Python code that integrates with LLM providers.
- Support improvements to system reliability and performance in production.
- Deliver well-scoped projects with guidance from senior engineers.
- Contribute to team excellence through code reviews and documentation.
- Collaborate with cross-functional partners to ship user-facing features.
Requirements
- 2–5 years of professional software engineering experience.
- Experience contributing to production systems as part of a team.
- Exposure to AI/ML systems with a strong interest in LLM-powered products.
- Experience debugging systems and working with data.
- Proficiency in Python or a similar language.
- Strong understanding of LLM concepts such as prompting and evaluation.
- Familiarity with backend systems, APIs, and cloud environments.
- Exposure to logging, monitoring, or debugging tools.
- Interest in learning tools like LangGraph and vector databases.
Benefits
- Medical and dental insurance.
- Life, AD&D, and disability insurance.
- Natural disaster support program.
- Wellness apps and paid parental leave.
- Paid time off inclusive of holidays and sick time.
- Working remotely stipend and WFH office set-up stipend.
- Retirement plan and financial planning.
- Learning and development budget.
Categories
AI & MLBackend