Senior Data Engineer
TripleLift2 months ago
Toronto, CanadaSenior
Responsibilities
- Create and maintain optimal data pipeline architecture.
- Explore and assemble large, complex datasets meeting functional and non-functional business requirements.
- Automate manual processes, optimize data delivery, and redesign infrastructure for scalability.
- Build extraction, transformation, and loading infrastructure using Spark, EMR, Kafka, and other big data technologies.
- Support product managers, engineers, analysts, and other stakeholders with data-related technical issues and infrastructure needs.
Requirements
- Bachelor’s degree in Computer Science, a related technical field, or equivalent professional experience.
- At least 5 years of professional software engineering experience focused on data and ML processes running in production at scale.
- Experience optimizing big data and ML pipelines such as Spark and Kafka at scale.
- Fundamental knowledge of ML and AI operations and processes.
- Experience with cross-functional data modeling.
- Strong SQL skills and expertise in Python, Scala, or Java.
- Knowledge of database technologies such as OpenSearch, Druid, ClickHouse, and InfluxDB.
- Experience with MLFlow, Feast, Ray, containerization, Kubernetes, and ArgoCD is a plus.
Tech Stack
Categories
Data Engineering
About TripleLift
TripleLift is a creative supply-side platform that supports programmatic advertising across online video, connected TV, display, and native formats for publishers, advertisers, and agencies. It provides a marketplace and ad-tech tools to monetize inventory and execute media buying, earning transaction-based fees. Founded in 2012 and headquartered in New York, the company is owned by Vista Equity Partners and handles over 1 trillion ad transactions each month.