Senior Software Engineer - Back-end/Data Pipeline - VenturaOS
The Trade Deskabout 8 hours ago
Base Salary
$125k - $229k/yr
Responsibilities
- Design, build, and maintain data pipelines for processing content catalog data.
- Develop efficient data processing workflows for large-scale data.
- Create robust APIs to securely expose data services.
- Collaborate with data scientists to integrate models in production.
- Build scalable data integration solutions connecting various data sources.
- Implement monitoring and observability for data pipelines.
- Optimize data storage and retrieval mechanisms.
- Contribute to architectural decisions around data infrastructure.
- Work with cross-functional teams to translate business requirements into technical solutions.
- Apply best practices for data engineering, including data quality checks.
Requirements
- 7+ years of software development experience, with at least 5 years in data engineering.
- Extensive experience with data warehousing solutions like Vertica, Snowflake, or Databricks.
- Strong knowledge of data governance and data quality frameworks.
- Hands-on experience with machine learning pipelines and MLOps.
- Expertise in content metadata processing and management.
- Familiarity with entertainment catalog systems and content discovery workflows.
- Prior work on recommendation systems or search technologies.
- Strong communication skills across technical and non-technical stakeholders.
- Solid foundation in computer science and engineering fundamentals.
- Deep experience with distributed systems and data processing frameworks.
- Proficiency in programming languages such as Java, Scala, or Python.
- Strong expertise in big data technologies like Apache Spark and Kafka.
- Solid understanding of data modeling concepts and experience with relational and NoSQL databases.
- Hands-on experience with cloud platforms like AWS, GCP, or Azure.
- Proven ability to lead projects with high levels of technical ambiguity.
- A Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
Benefits
- Comprehensive healthcare (medical, dental, and vision) with premiums paid in full for employees and dependents.
- Retirement benefits including a 401k plan and company match.
- Short and long-term disability coverage and basic life insurance.
- Well-being benefits and reimbursement for certain tuition expenses.
- Parental leave and sick time of 1 hour per 30 hours worked.
- Vacation time up to 120 hours in the first year and 160 hours thereafter.
- Around 13 paid holidays per year.
- Opportunity to purchase company stock at a discount through the Employee Stock Purchase Plan.