20 hours ago
Bengaluru, IndiaMid Level
Responsibilities
- Design, develop, and maintain scalable data pipelines and backend systems for advertising reporting, attribution, analytics, and measurement.
- Build and optimize batch and real-time data processing workflows using Spark, Hive, Kafka, SQL, and Scala.
- Work with large-scale datasets and distributed systems to ensure reliability, scalability, and performance.
- Develop and maintain data models, datasets, and APIs for advertising use cases.
- Ensure data quality, consistency, and reliability across data sources.
- Troubleshoot and resolve issues in batch-processing and real-time streaming pipelines.
- Participate in code reviews, debugging, and performance optimization.
- Collaborate with senior engineers, product managers, data scientists, and other engineering teams.
- Continuously learn and evaluate technologies for large-scale data processing and distributed systems.
Requirements
- 2–4 years of experience in data engineering, software development, backend engineering, or building large-scale data systems.
- Strong programming skills in Scala, Java, or Python.
- Hands-on experience with or strong exposure to Apache Spark for batch or streaming data processing.
- Good understanding of SQL, Hive, and data modeling concepts.
- Experience with Kafka or other messaging and event-streaming systems is preferred.
- Understanding of distributed systems and Big Data technologies.
- Strong problem-solving, debugging, and analytical skills.
- Familiarity with Presto, Delta Lake, Airflow, or similar technologies is a plus.
- Exposure to AWS, GCP, Databricks, or EMR is an advantage.
- Experience or interest in AdTech, campaign analytics, attribution, or large-scale consumer platforms is a plus.
- Bachelor’s or master’s degree in Computer Science, Engineering, or a related technical field.
Benefits
- Full-time employment.
- Onsite work in Bangalore.
Tech Stack
Apache AirflowApache HiveApache KafkaApache SparkAWSDatabricksGoogle Cloud PlatformJavaPrestoPythonScalaSQL
Categories
BackendData Engineering
About Hotstar
We’ve moved! 🌟 Follow us on @JioHotstar for all the latest stories, updates & more.
