Sr Product Software Engineer II
The Walt Disney Company4 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design and build scalable batch and streaming data pipelines using Spark, Scala, Python, and Airflow.
- Optimize ETL/ELT processes and performance in Databricks and Snowflake.
- Write efficient SQL to transform, validate, and surface large-scale datasets.
- Collaborate with data scientists, analysts, engineers, and BI teams to deliver production-grade pipelines and dashboard-ready data.
- Develop unit tests, conduct code reviews, and apply modularity, reusability, scalability, testability, and clean-code practices.
- Troubleshoot data issues, job failures, and performance bottlenecks.
- Contribute to documentation and reusable code libraries.
- Partner with BI teams to deliver well-modeled datasets optimized for dashboards and analysts.
Requirements
- 4–6 years of relevant data science, business intelligence, or data analytics experience, preferably in digital media or digital advertising.
- Bachelor’s degree in computer science, data analytics or science, applied mathematics, statistics, a related technical field, or equivalent experience.
- Expert-level knowledge of at least one programming language such as Python, R, Scala, or Java.
- Strong SQL experience, including complex queries against distributed data stores such as Aurora, Hadoop, Hive, Oracle, and Snowflake.
- Experience with Apache NiFi or Apache Airflow and data pipeline or workflow management.
- Experience with Scala, Python, SQL, Apache Spark, Flink, Databricks, Hive, Presto, Snowflake, and AWS data services.
- Experience with BI tools such as MicroStrategy, Tableau, Business Objects, or Looker.
- Experience working with large datasets of terabytes or more.
- Ability to communicate complex concepts to technical and non-technical audiences, with strong presentation and documentation skills.
- Experience with digital advertising systems, advertising workflow troubleshooting, network topologies, systems architecture, and entity relationship diagrams is preferred.
Tech Stack
Apache AirflowApache FlinkApache HadoopApache HiveApache SparkAWSDatabricksJavaPrestoPythonRScalaSnowflakeSQL
Categories
Data Engineering
About The Walt Disney Company
The Walt Disney Company is a diversified entertainment business that produces films and television, operates theme parks and resorts, and runs streaming services including Disney+, Hulu, and ESPN+. It earns revenue from subscriptions and advertising, theatrical distribution, licensing and merchandise, and park admissions and experiences. Founded in 1923 and headquartered in Burbank, California, Disney owns brands such as Pixar, Marvel, Lucasfilm, and 20th Century Studios and serves audiences worldwide.