2 months ago
Gurgaon, IndiaSenior
Responsibilities
- Develop and maintain Microsoft Fabric and OneLake Lakehouse solutions across Bronze, Silver, and Gold layers.
- Build reusable ingestion pipelines and CDC frameworks for GCP, CSV, Excel, email files, and SharePoint sources.
- Implement audit logging, schema validation, schema-drift detection, error handling, data quality checks, reconciliation, monitoring, and operational controls.
- Develop Silver-layer transformations and Gold-layer datasets containing curated entities, conformed dimensions, metrics, KPIs, aggregations, and secure views.
- Optimize Spark, PySpark, Python, and SQL workloads and build pipelines using Fabric Data Pipelines, Synapse Pipelines, and Notebooks.
- Support Power BI semantic models and Direct Lake data consumption.
- Apply Purview, RBAC, PII/PHI controls, classification, lineage, and other data governance and security standards.
- Troubleshoot pipeline failures, performance issues, data discrepancies, and production incidents.
- Collaborate with Solution Architects, Lead Data Engineers, BI teams, and business stakeholders.
Requirements
- 5+ years of overall data engineering experience with hands-on Azure and Microsoft Fabric experience.
- Strong hands-on experience with Microsoft Fabric Lakehouse, OneLake, Warehouse, Data Pipelines, and Notebooks.
- Proficiency in Spark/PySpark, Python, SQL, and Delta Lake.
- Experience with ETL/ELT, CDC, data ingestion, transformation, and Medallion Architecture.
- Experience developing data quality, validation, reconciliation, and exception-handling frameworks.
- Knowledge of Power BI semantic models and Direct Lake.
- Experience with Microsoft Purview, Azure DevOps, Git, CI/CD, and deployment.
- Commercial insurance or brokerage data experience is preferred.
Categories
Data Engineering
About EXL
EXL provides data analytics, AI, and digital operations services for enterprises in insurance, healthcare, banking, and other regulated industries. It delivers consulting, managed services, and technology platforms to improve decision-making, risk management, and operational efficiency. Founded in 1999 and headquartered in New York, EXL is a public company listed on the NASDAQ (ticker: EXLS).