Senior Lead Machine Learning Engineer, Agentic AI
Upwork
23 days ago
Toronto, Canada
Senior / Staff+
H1B Sponsor
Responsibilities
- Design and implement multi-agent systems with robust guardrails.
- Develop protocol-aware agents that integrate with developer tooling.
- Ensure reliability at scale through deterministic execution and evaluation-driven iteration.
- Lead data strategy and curation for agent tasks, focusing on safety tuning.
- Establish evaluation harnesses for metrics like success rate and latency.
- Build policy-driven guardrails in collaboration with Legal/Security.
- Architect low-latency backend infrastructure for agentic platforms.
- Ship production-grade services that facilitate easy integration for developers.
- Optimize cost and performance through various engineering techniques.
- Provide technical leadership and mentorship across teams.
Requirements
- 8–12+ years in applied ML/ML systems with 4+ years in LLM-powered products.
- Hands-on mastery of LLM adaptation and safety/guardrails.
- Strong software fundamentals in distributed systems and microservices.
- Fluency in Python and proficiency in Go/Java/Javascript is a plus.
- Experience designing evaluation suites for agents.
- Comfort with cost, latency, and reliability trade-offs.
- Familiarity with agent frameworks and developer productivity tools.
- Proven track record of leading cross-functional initiatives.
Tech Stack
GoJavaJavaScriptPython
Categories
AI & MLData Science