Hotstar

Staff Software Development Engineer

Hotstar
Apply
1 day ago
Bengaluru, IndiaStaff+

Responsibilities

  • Design, develop, and maintain large-scale data pipelines for advertising reporting, attribution, and analytics.
  • Use Hive, Spark, SQL, Scala, and Kafka to process and manage petabyte-scale datasets.
  • Optimize data workflows for performance, scalability, and cost efficiency.
  • Partner with data scientists, product managers, and platform engineers to deliver reliable datasets and APIs.
  • Ensure data quality, integrity, and consistency across multiple data sources.
  • Troubleshoot real-time streaming pipelines and batch data jobs.
  • Evaluate technologies that can improve the Ads Data platform.
  • Lead large-scale projects, shape system architecture, and mentor other engineers.

Requirements

  • Strong programming experience in Scala, Java, or Python, with Scala preferred.
  • Hands-on experience with Apache Spark for batch and streaming data processing.
  • Proficiency in Hive, SQL, and data modeling for analytical workloads.
  • Experience with Kafka for real-time event streaming.
  • Understanding of big-data ecosystems including S4, Hive, Presto, and Delta.
  • Strong debugging, performance-tuning, and problem-solving skills.
  • Bachelor’s or master’s degree in computer science, engineering, or a related field.
  • Experience in AdTech, attribution, or campaign analytics.
  • Familiarity with cloud-based big-data solutions such as AWS EMR, GCP BigQuery, and Databricks.
  • Familiarity with scheduling services such as AirFlow.
  • Knowledge of data governance, security, and compliance best practices.
  • Bachelor’s or master’s degree in computer science or a related field with 6–9 years of backend development experience.

Benefits

  • Onsite work in Bangalore.
  • Full-time employment.
  • Equal opportunity workplace focused on diversity and inclusion.

Tech Stack

Apache AirflowApache HiveApache KafkaApache SparkAWSDatabricksGoogle Cloud PlatformJavaPrestoPythonScalaSQL

Categories

BackendData Engineering
Hotstar

About Hotstar

501-1,000 employees

We’ve moved! 🌟 Follow us on @JioHotstar for all the latest stories, updates & more.

Contact me