Consultant | Microsoft Azure | Kolkata | Engineering | Data Modernization & Migration
Deloitte Advisory1 day ago
Kolkāta, IndiaMid Level
Responsibilities
- Design and develop scalable batch and incremental data pipelines using Fabric Data Factory or Azure Data Factory.
- Build Fabric Lakehouse and Warehouse solutions using OneLake, Delta tables, SQL, and Spark.
- Develop reusable Python and PySpark notebooks for transformations and data-quality processing.
- Implement full-load, incremental-load, CDC, and parameter-driven pipeline patterns.
- Create curated data layers for reporting, analytics, and downstream consumption.
- Implement logging, exception handling, alerts, retry mechanisms, and audit controls.
- Optimize SQL queries, Spark jobs, pipelines, data models, and storage structures.
- Support deployments across development, test, and production environments.
- Troubleshoot production incidents and conduct root-cause analysis.
- Collaborate with business analysts, architects, report developers, and source-system teams.
- Perform peer reviews and mentor Level 1 engineers.
Requirements
- Strong SQL skills, including joins, window functions, CTEs, stored procedures, and performance tuning.
- Hands-on experience with Python and/or PySpark.
- Experience with Azure Data Factory or Fabric Data Factory.
- Experience with Lakehouse, data warehouse, or enterprise data-platform solutions.
- Knowledge of Delta Lake, Parquet, partitioning, and medallion architecture.
- Understanding of data modeling, including star and snowflake schemas.
- Experience using Git and CI/CD tools such as Azure DevOps.
- Working knowledge of Power BI semantic models and reporting requirements.
- Understanding of identity, role-based access, secrets, and cloud security.
- Bachelor-level BTECH or BCA education.
- Preferred experience with Fabric OneLake, shortcuts, Warehouse, Data Engineering, or Real-Time Intelligence.
- Preferred experience migrating data workloads from on-premises or legacy platforms to Azure or Fabric.
- Preferred knowledge of Azure SQL, ADLS Gen2, Synapse Analytics, Azure Functions, or Databricks.
- Preferred experience with REST APIs, JSON, event-based ingestion, or streaming data.
- Microsoft Fabric Analytics Engineer or Azure Data Engineer certification is preferred.
Tech Stack
Categories
Data Engineering
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.