Senior Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate
Deloitte Advisory1 day ago
Bengaluru, IndiaSenior
Responsibilities
- Manage production incidents, triage issues, perform root-cause analysis, and support timely resolution through Tier 1 and Tier 2 support.
- Mentor members of the Data Reliability Engineering team and provide recommendations to engineering partners through root-cause analyses.
- Design and develop platforms for incident observability and automation.
- Build data models and products that monitor data pipeline health and data quality.
- Maintain, improve, and performance-tune big data pipeline infrastructure while responding to incidents.
- Build intelligent monitoring, automated anomaly detection, and alerting for data pipelines and infrastructure.
- Present research and insights clearly to audiences across the company.
- Participate in rotating on-call shifts, including weekend coverage.
Requirements
- At least 5 years of experience working with mission-critical data pipelines and ETL systems.
- At least 5 years of hands-on experience with big data technologies, systems, and tools such as AWS, Hadoop, Hive, and Snowflake.
- Expertise in common data engineering languages including Python, Scala, Java, and SQL, with the ability to learn new programming languages.
- Experience with workflow orchestration tools such as Airflow.
- Deep understanding of end-to-end pipeline design and implementation.
- A degree in Computer Science, Engineering, or a related field.
- Strong problem-solving, ownership, attention to detail, interpersonal, and communication skills.
- Preferred advanced degree, data visualization skills, independent project ownership, presentation skills, DevOps tooling experience, and event messaging experience with frameworks such as Apache Kafka.
Benefits
- Rotating on-call schedule includes weekend shifts.
- The team states that it supports a healthy work-life balance.
Tech Stack
Apache AirflowApache HadoopApache HiveApache KafkaAWSDockerJavaJenkinsKubernetesPythonScalaSnowflakeSQL
Categories
Data Engineering
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.