28 days ago
Vancouver, CanadaStaff+
Responsibilities
- Design, build, and operate production AI agents and services with appropriate safeguards.
- Own AI development infrastructure including evaluation frameworks, prompt optimization, LLM observability, performance optimization, and cost management.
- Establish reusable patterns for retrieval, tool calling, guardrails, model selection, and AI application development.
- Design experiments, evaluation datasets, automated graders, regression tests, and quality, safety, performance, and cost measurements.
- Build and maintain ELT pipelines, dbt models, data marts, datasets, and experimentation infrastructure.
- Maintain data quality tests, freshness checks, alerts, pipeline reliability, warehouse governance, security, performance, and cost management.
- Build event data pipelines from Segment into Amplitude, Iterable, and Snowflake and support product instrumentation and experimentation.
- Build and maintain Amplitude dashboards and reports for product analytics.
- Partner with product and engineering teams to integrate AI capabilities into production applications through APIs.
Requirements
- 6+ years of experience in software, data, or ML engineering, including 2+ years building and operating LLM applications in production.
- Strong Python and SQL skills and experience building reliable production systems.
- Hands-on experience with AI agents, LLM APIs, agent frameworks, tool calling, retrieval, and structured outputs.
- Experience designing and running LLM evaluations, including test datasets, automated graders, regression testing, and systematic experimentation.
- Experience with LLM observability, performance optimization, and production cost management.
- Experience deploying and operating services on AWS, GCP, or Azure with containers and CI/CD pipelines.
- Working knowledge of data platforms including Snowflake or similar warehouses, dbt, and orchestration tools such as Prefect, Airflow, or Dagster.
- Familiarity with product analytics and event-tracking platforms such as Segment and Amplitude, or willingness to learn.
- Familiarity with BI tools such as Sigma, Looker, or Tableau.
- Bonus experience with prompt optimization, semantic layers, data contracts, or A/B testing and experimentation infrastructure.
- Ability to make technical decisions, work across data, product, and engineering teams, communicate clearly, document work, and operate independently in a small team.
Benefits
- Competitive salary range of $185K-$220K CAD.
- Hybrid working location.
- Health, dental, and vision insurance.
- Life and disability insurance.
- Flexible PTO.
- Mental wellbeing options.
- Robust holiday schedule.
- Registered Retirement Savings Plan.
- Growth opportunities.
Tech Stack
Categories
AI ApplicationsData Engineering
About Dutch
Dutch is a veterinary telehealth and pharmacy service for pet owners, offering virtual exams with licensed vets who can diagnose, prescribe, and deliver medications in most U.S. states. The company runs a membership-based model with online visits and home-shipped treatments, and was founded in 2021 and is headquartered in Oakland, California.