Sr Data Engineer I
The Walt Disney Company5 months ago
Bengaluru, IndiaSenior
Responsibilities
- Contribute to the architecture, design, and growth of data products and data pipelines using Scala, Python, and Spark.
- Build scalable ETL solutions in cloud, on-premises, and hybrid big-data environments.
- Implement Lakehouse architecture and help transition the data platform toward a Lakehouse-centric model.
- Collaborate with Data Product Managers, Data Architects, and Data Engineers to deliver data solutions.
- Maintain detailed documentation supporting data quality and data governance.
- Meet operational efficiency, quality, uptime, and customer-support SLAs.
- Research solutions to technical and business challenges and automate processes while optimizing costs.
- Build relationships with customers and stakeholders to prioritize new offerings and platform improvements.
- Participate in Scrum and Agile practices and support team health and process improvements.
Requirements
- At least 5 years of data engineering experience developing large data pipelines.
- Hands-on experience with AWS, including S3, EMR, and EC2, and with building data pipelines.
- Strong algorithmic problem-solving, SQL, Scala, and Python skills.
- Experience with distributed systems such as Spark, Hadoop, HDFS, Hive, Presto, and PySpark.
- Experience with at least one major MPP or cloud database such as Snowflake, Redshift, or BigQuery.
- Experience with Airflow and with writing and maintaining Databricks data pipelines.
- Experience with data modeling and data warehousing methodologies and practices.
- Bachelor’s degree in computer science, information systems, software engineering, electrical or electronics engineering, or a comparable field, and/or equivalent work experience.
- Preferred experience with software application development, test-first practices, infrastructure as code, and major cloud providers.
- Ability to understand data domains, explain analysis in business context, communicate effectively, and build consensus across cross-functional teams.
Benefits
- Full-time employment.
- Work location listed as Bangalore, India.
Tech Stack
Amazon RedshiftApache AirflowApache HadoopApache HiveApache SparkAWSDatabricksGoogle BigQueryPrestoPythonScalaSnowflakeSQL
Categories
Data Engineering
About The Walt Disney Company
The Walt Disney Company is a diversified entertainment business that produces films and television, operates theme parks and resorts, and runs streaming services including Disney+, Hulu, and ESPN+. It earns revenue from subscriptions and advertising, theatrical distribution, licensing and merchandise, and park admissions and experiences. Founded in 1923 and headquartered in Burbank, California, Disney owns brands such as Pixar, Marvel, Lucasfilm, and 20th Century Studios and serves audiences worldwide.