Senior Data Engineer
TripleLift11 hours ago
Base Salary
$130k - $170k/yr
Responsibilities
- Create and maintain scalable data pipeline architecture.
- Explore and assemble large, complex datasets to meet functional and non-functional business requirements.
- Automate manual processes, optimize data delivery, and redesign infrastructure for greater scalability.
- Build extraction, transformation, and loading infrastructure using Spark, EMR, Kafka, and other big data technologies.
- Collaborate with product managers, engineers, analysts, and other stakeholders on data-related technical issues and infrastructure needs.
Requirements
- Bachelor’s degree in Computer Science, a related technical field, or equivalent professional experience.
- At least 5 years of professional software engineering experience focused on production-scale data and ML processes.
- Experience optimizing big data and ML pipelines such as Spark and Kafka at scale.
- Fundamental knowledge of ML and AI operations and processes.
- Experience with database technologies such as OpenSearch, Druid, ClickHouse, and InfluxDB.
- Proven experience with cross-functional data modeling.
- Strong SQL skills and expertise in Python, Scala, or Java.
- Experience with containerization, Kubernetes, and ArgoCD is a plus.
- Experience with MLflow, Feast, Ray, and other AI training technologies is a plus.
Benefits
- Medical, dental, and vision plans are available to eligible employees.
- Flexible paid time off is available.
- 401(k) with employer match is available.
- The role is full-time and eligible employees receive comprehensive benefits subject to applicable plans and policies.
- Additional rewards may include bonuses and region-specific benefits.
Tech Stack
Categories
Data Engineering
About TripleLift
TripleLift is a creative supply-side platform that supports programmatic advertising across online video, connected TV, display, and native formats for publishers, advertisers, and agencies. It provides a marketplace and ad-tech tools to monetize inventory and execute media buying, earning transaction-based fees. Founded in 2012 and headquartered in New York, the company is owned by Vista Equity Partners and handles over 1 trillion ad transactions each month.