Senior AI Engineer
Guidepoint4 hours ago
Toronto, CanadaSenior
Responsibilities
- Build real-time voice- and chat-based conversational AI agents with low-latency requirements.
- Develop agentic LLM orchestration, multi-channel session management, retrieval and grounding, and structured data flows.
- Design and tune LLM pipelines, including context engineering, structured outputs, model selection, and cost/latency tradeoffs.
- Build evaluation infrastructure, define quality metrics, run experiments, and gate releases based on measured results.
- Design, implement, deploy, and operate services using Kubernetes and Azure, including latency-sensitive workloads.
- Integrate third-party AI and voice vendors behind maintainable abstractions.
- Partner with product and compliance stakeholders to encode domain rules into systems.
- Establish engineering practices including code review, observability, and incident response habits.
Requirements
- 6+ years of software engineering experience.
- 2+ years building production LLM-powered products, including orchestration, retrieval-augmented generation/grounding, structured outputs, and evaluation-driven iteration.
- Strong TypeScript or Python skills and comfort working across both.
- Experience with real-time or streaming systems such as WebSockets, WebRTC, or audio pipelines.
- Cloud-native production experience with containers, Kubernetes, CI/CD, and observability; Azure experience is a plus.
- Familiarity with LangGraph, LangChain, or CrewAI, with hands-on exposure sufficient.
- Working familiarity with vector databases and embedding-based retrieval.
- Pragmatic product judgment and experience scoping prototypes, evaluating approaches with data, and shipping.
- Nice-to-have experience with telephony platforms, conversational agent frameworks, speech-to-text/text-to-speech, turn-taking or voice activity detection, knowledge graphs, large-scale search/retrieval, regulated domains, evaluation harnesses, or LLM-as-judge systems.
Benefits
- Hybrid work in the Toronto office.
- Paid time off.
- Comprehensive benefits plan.
- Company RRSP match.
- Development opportunities through LinkedIn Learning.
Tech Stack
Categories
About Guidepoint
Guidepoint provides on-demand expert consultations, surveys, events, and custom research that help investors, consultants, and corporate teams make informed decisions. It operates a large global network of subject-matter experts and offers access via subscriptions and project-based engagements. Founded in 2003 and headquartered in New York, the privately held company serves sectors including healthcare, consumer goods, technology, media and telecom, and energy.