Enabling Areas - IT - Assistant Manager - Data Engineer
Deloitte Advisory10 days ago
Mumbai, IndiaStaff+
Responsibilities
- Design, develop, and manage batch and real-time ETL/ELT pipelines using Azure Data Factory and Databricks.
- Integrate data from SQL Server, Azure SQL Database, Azure Data Lake Storage, and external APIs.
- Build and maintain data models, data marts, and data warehouses using SQL Server and Azure Synapse Analytics.
- Write optimized SQL queries, stored procedures, views, and triggers in SQL Server.
- Process large datasets for transformation and analytics using Databricks with Spark, Python, or Scala.
- Ensure data quality, integrity, security, and compliance through validation, monitoring, and auditing.
- Collaborate with data analysts, data scientists, and business stakeholders to define and deliver data solutions.
- Implement CI/CD pipelines using Azure DevOps and monitor and optimize data pipeline and query performance.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field.
- At least 3 years of experience in data engineering or related roles.
- Expertise with Azure Data Factory, Azure Data Lake Storage, Azure SQL, and Azure Synapse Analytics.
- Experience with Azure Databricks and Spark using Python or Scala.
- Advanced Microsoft SQL Server skills, including stored procedures and performance tuning.
- Strong understanding of data warehousing, ETL/ELT best practices, and star and snowflake data models.
- Familiarity with data governance, role-based access control, and Azure data security practices.
- Experience with Azure DevOps, CI/CD tools, and Git version control.
- Strong problem-solving skills and ability to collaborate in a fast-paced environment.
Tech Stack
Categories
Data Engineering
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.