Hotstar

Software Development Engineer II

Hotstar
Apply
20 hours ago
Bengaluru, IndiaMid Level

Responsibilities

  • Design, develop, and maintain scalable data pipelines and backend systems for advertising reporting, attribution, analytics, and measurement.
  • Build and optimize batch and real-time data processing workflows using Spark, Hive, Kafka, SQL, and Scala.
  • Work with large-scale datasets and distributed systems to ensure reliability, scalability, and performance.
  • Develop and maintain data models, datasets, and APIs for advertising use cases.
  • Ensure data quality, consistency, and reliability across data sources.
  • Troubleshoot and resolve issues in batch-processing and real-time streaming pipelines.
  • Participate in code reviews, debugging, and performance optimization.
  • Collaborate with senior engineers, product managers, data scientists, and other engineering teams.
  • Continuously learn and evaluate technologies for large-scale data processing and distributed systems.

Requirements

  • 2–4 years of experience in data engineering, software development, backend engineering, or building large-scale data systems.
  • Strong programming skills in Scala, Java, or Python.
  • Hands-on experience with or strong exposure to Apache Spark for batch or streaming data processing.
  • Good understanding of SQL, Hive, and data modeling concepts.
  • Experience with Kafka or other messaging and event-streaming systems is preferred.
  • Understanding of distributed systems and Big Data technologies.
  • Strong problem-solving, debugging, and analytical skills.
  • Familiarity with Presto, Delta Lake, Airflow, or similar technologies is a plus.
  • Exposure to AWS, GCP, Databricks, or EMR is an advantage.
  • Experience or interest in AdTech, campaign analytics, attribution, or large-scale consumer platforms is a plus.
  • Bachelor’s or master’s degree in Computer Science, Engineering, or a related technical field.

Benefits

  • Full-time employment.
  • Onsite work in Bangalore.

Tech Stack

Apache AirflowApache HiveApache KafkaApache SparkAWSDatabricksGoogle Cloud PlatformJavaPrestoPythonScalaSQL

Categories

BackendData Engineering
Hotstar

About Hotstar

501-1,000 employees

We’ve moved! 🌟 Follow us on @JioHotstar for all the latest stories, updates & more.

Contact me