Azure Data Engineer
Ernst and Young2 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design, build, and optimize enterprise analytics platforms using Microsoft Fabric, OneLake, Lakehouse, Medallion architecture, Fabric Pipelines, Dataflow Gen2, Notebooks, Mirroring, Event Streams, and Shortcuts.
- Develop data ingestion and integration solutions across ADLS Gen2, Azure services, Dataverse, SaaS platforms, ServiceNow, Microsoft 365, and external cloud storage.
- Build semantic models, Direct Lake datasets, Power BI solutions, KPI frameworks, operational metrics, trend analysis, root cause analysis, and business intelligence reporting.
- Implement data governance, security, lineage, auditing, compliance, lifecycle management, performance optimization, and quality controls.
- Design cloud-native automation and workflow orchestration using Azure Logic Apps, Power Automate, Power Apps, APIs, webhooks, and event-driven services.
- Develop reusable APIs, connectors, integration frameworks, and data exchange services across Azure, ServiceNow, security platforms, CMDBs, inventory systems, and third-party SaaS applications.
- Create operational intelligence solutions for telemetry, logs, platform health, incidents, requests, and service management data.
- Automate ticket creation, escalations, notifications, exception management, remediation, approvals, and other ServiceNow operational processes.
- Build closed-loop intelligence and feedback mechanisms that convert insights, anomalies, recommendations, and RCA findings into automated actions.
- Establish CI/CD, deployment, testing, monitoring, logging, resiliency, operational readiness, and support practices across analytics, integration, and automation platforms.
- Partner with stakeholders to identify automation opportunities, lead technical discussions, influence architecture, and continuously improve operational processes.
Requirements
- Bachelor’s or master’s degree in Computer Science, Information Technology, Data Analytics, Engineering, or a related field.
- At least nine years of total experience, including five or more years in data engineering, cloud engineering, automation engineering, analytics, platform engineering, or related technical disciplines.
- Hands-on experience with Microsoft Fabric Data Factory, OneLake, Lakehouse, Dataflow Gen2, Notebooks, Semantic Models, Direct Lake, Fabric Pipelines, and Event Streams.
- Strong proficiency in SQL and Python/PySpark, with experience designing Bronze, Silver, and Gold data architectures.
- Experience with data modeling, dimensional modeling, semantic modeling, Power BI, data lakes, large-scale enterprise datasets, governance, lineage, auditing, security, and compliance.
- Experience building executive dashboards, KPI frameworks, and operational reporting solutions.
- Hands-on experience with Azure Logic Apps, Power Automate, Power Platform, REST APIs, JSON, webhooks, and API-driven architectures.
- Experience integrating cloud services, SaaS applications, Microsoft 365, ServiceNow, and enterprise platforms using event-driven architectures and automation frameworks.
- Experience with one or more of Azure Data Explorer, Azure Data Factory, Azure Functions, Azure Event Hub, Azure Service Bus, and ServiceNow Platform.
- Experience with Azure DevOps, Git, CI/CD pipelines, automated deployment, and infrastructure as code using Terraform, Bicep, or ARM templates.
- Understanding of platform monitoring, observability, resiliency, operational support, security concepts, and enterprise integration patterns.
- Strong analytical, problem-solving, stakeholder management, communication, collaboration, and technical leadership skills.
- Preferred certifications include Microsoft Fabric Analytics Engineer Associate, Microsoft Power Platform certifications, Azure Data Engineer Associate, Azure Solutions Architect Expert, and relevant analytics, integration, or automation certifications.
- Experience supporting a Security or Information Security organization is highly desirable.
Benefits
- Competitive remuneration package based on individual and team performance.
- Flexible working and career development support through EY’s Total Rewards package and FlexEY benefits selection.
- Benefits covering holidays, health and well-being, insurance, savings, discounts, offers, and promotions.
- Coaching, feedback, skill-development opportunities, and career progression.
- Freedom and flexibility to manage the role in a way that suits the employee.
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.