Senior Software Engineer I
The Walt Disney Company6 months ago
Bengaluru, IndiaSenior
Responsibilities
- Build software for large-scale real-time and batch data pipelines supporting analytics, data science, and operations.
- Develop privacy solutions and data-subject-rights automation across Disney’s data ecosystem.
- Evolve the platform, identify new use cases and features, and drive adoption of engineering and data practices.
- Build observability, alerting, logging, and system control-plane capabilities for diagnosing data-pipeline issues.
- Maintain and expand software deployments while meeting strict uptime SLAs.
- Document work and changes to support data quality and data governance requirements.
- Collaborate with product managers, architects, engineers, analytics, legal, security, and data architecture partners.
- Participate in Scrum and Agile ceremonies and help improve team processes.
Requirements
- At least 5 years of data engineering experience in software engineering and data systems.
- Strong algorithmic problem-solving expertise.
- Strong Scala and Python programming skills and strong SQL skills.
- Production experience with distributed processing systems such as Apache Spark.
- Production experience with workflow orchestration systems such as Airflow for creating and maintaining data pipelines.
- Experience with scripting languages such as Bash or PowerShell.
- Experience or familiarity with technologies including OneTrust, Databricks, Jupyter, Snowflake, Redshift, DynamoDB, Redis, Kubernetes, Kinesis, REST APIs, Terraform, and Go.
- Experience with at least one major MPP or cloud database such as Snowflake, Redshift, or BigQuery.
- Experience developing APIs with GraphQL.
- Deep understanding of AWS or another cloud provider and infrastructure as code.
- Familiarity with data modeling, data warehousing practices, privacy regulations, and data-subject rights.
- Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or a comparable field, and/or equivalent work experience.
- A master’s degree in Computer Science or Information Systems is preferred.
- Strong analytical, communication, and problem-solving skills, with willingness to learn new skills.
Tech Stack
Amazon DynamoDBAmazon RedshiftApache AirflowApache SparkAWSBashDatabricksGoGoogle BigQueryGraphQLKubernetesPowerShellPythonRedisScalaSnowflakeSQLTerraform
Categories
Data Engineering