Senior Consultant - Tech Consulting - National - CNS - TC - Digital Engineering - New Delhi
Ernst and Young1 day ago
Ahmedabad, IndiaSenior
Responsibilities
- Design Azure Databricks lakehouse architectures using Delta Lake and Unity Catalog.
- Define Bronze, Silver, and Gold medallion patterns, data models, and enterprise data products.
- Architect batch, streaming, and CDC ingestion frameworks using Auto Loader, Azure Data Factory, Event Hubs, and Kafka.
- Establish governance, security, RBAC, lineage, and privacy controls using Unity Catalog, Key Vault, and service principals.
- Optimize cluster sizing, Photon, Liquid Clustering, Z-Order, caching, performance, and cost.
- Lead CI/CD and infrastructure practices using Databricks Asset Bundles, Git, Azure DevOps, GitHub Actions, Terraform, and Bicep.
- Guide teams on Delta Live Tables, MLflow, Delta Sharing, and Lakehouse Monitoring.
- Partner with Cyber, Cloud, and IAM teams on approvals, allow-listing, and compliance.
- Mentor data engineers and review designs, code, and production readiness.
- Provide practical solutions across multiple client departments while following commercial and legal requirements.
Requirements
- Deep expertise in Azure Databricks, Delta Lake, Unity Catalog, and Spark using PySpark and SQL.
- Strong experience with Azure services including ADLS Gen2, Azure Data Factory, Synapse, Key Vault, Entra ID, Event Hubs, and Functions.
- Proven experience designing enterprise-scale medallion and lakehouse architectures.
- Strong data modeling knowledge including dimensional modeling, Data Vault, or 3NF, along with SQL performance tuning.
- Experience with CI/CD, infrastructure as code using Terraform or Bicep, Git-based workflows, and DevOps practices.
- Knowledge of data governance, lineage, security, and privacy controls in regulated environments.
- Ability to collaborate across client departments, solve complex problems, and deliver practical solutions.
- Ability to work adaptably and creatively in collaborative consulting engagements.
Benefits
- Training, skills development, learning resources, and a personalized Career Journey.
- Opportunities to work with entrepreneurs, game-changers, disruptors, and visionaries across industries.
- Inclusive workplace focused on career development, client service, and employee wellbeing.
Tech Stack
Categories
Data Engineering
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.