Senior Data Engineer
TripleLift8 days ago
Pune, IndiaSenior
Responsibilities
- Create and maintain optimal data pipeline architecture.
- Explore and assemble large, complex datasets that meet functional and non-functional business requirements.
- Automate manual processes, optimize data delivery, and redesign infrastructure for greater scalability.
- Build extraction, transformation, and loading infrastructure using Spark, EMR, Kafka, and other big data technologies.
- Collaborate with product managers, engineers, analysts, and other stakeholders on data-related technical issues and infrastructure needs.
Requirements
- Bachelor’s degree in Computer Science, a related technical field, or equivalent professional experience.
- At least 5 years of professional software engineering experience focused on data and ML processes running in production at scale.
- Experience optimizing big data and ML pipelines such as Spark and Kafka at scale.
- Fundamental knowledge of ML and AI operations and processes.
- Understanding of database technologies such as OpenSearch, Druid, ClickHouse, and InfluxDB.
- Proven experience with cross-functional data modeling.
- Strong SQL skills and expertise in Python, Scala, or Java, or familiarity with multiple of these languages.
- Experience with MLFlow, Feast, Ray, containerization, Kubernetes, and Argo CD is a plus.
Tech Stack
Categories
Data Engineering
About TripleLift
TripleLift is a creative supply-side platform that supports programmatic advertising across online video, connected TV, display, and native formats for publishers, advertisers, and agencies. It provides a marketplace and ad-tech tools to monetize inventory and execute media buying, earning transaction-based fees. Founded in 2012 and headquartered in New York, the company is owned by Vista Equity Partners and handles over 1 trillion ad transactions each month.