Senior Software Development Engineer - Data Engineer

1 month ago

Mumbai, IndiaSenior / Staff+

Responsibilities

Design, develop, and maintain batch and near-real-time data pipelines.
Implement and manage data ingestion, ETL/ELT workflows, and transformations from internal and external data sources.
Build and optimize scalable data-processing solutions using distributed computing frameworks such as Apache Spark.
Develop and manage datasets for analytics, dashboards, and reporting.
Monitor pipeline performance, data freshness, and reliability, and resolve issues proactively.
Translate stakeholder data requirements into technical solutions.
Apply data governance, security, and engineering best practices.
Participate in code reviews, design discussions, and continuous improvement initiatives.

Strong experience with data engineering and data pipelining concepts.
Hands-on experience with distributed data processing frameworks such as Apache Spark.
Experience building data solutions on Google Cloud Platform, including Google Cloud Storage, BigQuery, Dataproc or Dataflow, and Pub/Sub.
Strong SQL skills and experience working with large datasets.
Proficiency in Python; Java or Scala experience is a plus.
Experience integrating data from multiple heterogeneous data sources.
Understanding of distributed systems, parallel processing, and performance optimization.
Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent practical experience.
5–7 years of hands-on experience in data engineering or big data roles.
Strong experience working in complex, large-scale data environments.

501-1,000 employees

We’ve moved! 🌟 Follow us on @JioHotstar for all the latest stories, updates & more.