Technical Director, Data Engineering

1 day ago

Vancouver, CanadaStaff+Sponsorship has conditions

Responsibilities

Design and build scalable data platforms, distributed processing systems, ingestion pipelines, transformation pipelines, and retrieval systems.
Build production systems supporting AI/LLM applications, semantic search, RAG, vector search, and agentic workflows.
Work hands-on with engineering teams to implement and debug production-grade solutions.
Evaluate and standardize frameworks, tooling, and infrastructure patterns across teams.
Improve data-system performance, reliability, observability, operational simplicity, and cost efficiency.
Partner with product and platform engineering teams to accelerate AI-native capabilities.
Mentor engineers through design reviews, architecture guidance, and pair debugging.
Establish engineering standards for CI/CD, testing, data quality, monitoring, and operational excellence.
Modernize legacy platforms and evolve architectures incrementally while balancing delivery speed and maintainability.

Significant real-world experience building and operating production systems and distributed data platforms.
Experience with data and distributed systems such as Airflow, Elasticsearch or OpenSearch, vector databases, semantic retrieval systems, MongoDB, PostgreSQL, or DynamoDB.
Experience with AWS, AWS CDK, serverless architectures, and distributed observability or monitoring stacks.
Experience with LLM integration patterns, RAG architectures, embeddings, vector search, MCP servers, AI orchestration frameworks, and AI evaluation or tracing tooling.
Experience with search relevance and ranking systems, API design, distributed services, and event-driven or asynchronous systems.
Strong Python experience preferred; Java, Go, or TypeScript experience is a plus.
Strong technical depth, hands-on coding and debugging ability, and experience simplifying and modernizing complex systems.
Experience with large-scale news, document, or regulatory data pipelines, search-relevance tuning, semantic retrieval, governance, compliance, risk, enterprise SaaS, or agentic systems is preferred.

Flexible work environment with comprehensive health benefits, generous time off, wellness programs, meeting-free days, and global days of service.
Hybrid work model requiring employees within commuting distance of a Diligent office to work onsite at least 50% of the time.
Access to employee resource groups and diversity, education, and inclusion resources.
Visa sponsorship may be available for select positions based on business needs and role requirements.

Sponsorship has conditions

Sponsorship decisions are evaluated on a case-by-case basis, and eligibility should not be assumed for all opportunities
From this job posting

Diligent Corporation’s past filings provide context. They do not guarantee sponsorship for a current opening.

Verified yearly history is not available for this company.

A job-field breakdown is not available for this company.

1,001-5,000 employees