2 months ago
Pune, IndiaSenior
Responsibilities
- Develop and maintain Microsoft Fabric and OneLake Lakehouse solutions across Bronze, Silver, and Gold layers.
- Build reusable data ingestion pipelines and CDC frameworks for GCP, CSV, Excel, email files, and SharePoint sources.
- Implement audit logging, schema validation, schema-drift detection, error handling, cleansing, standardization, validation, and exception handling.
- Build Gold-layer datasets with curated entities, conformed dimensions, business metrics, KPIs, aggregations, and secure views.
- Develop and optimize Spark/PySpark, Python, and SQL workloads for scalable data processing.
- Build pipelines using Fabric Data Pipelines, Synapse Pipelines, and Notebooks.
- Support Power BI semantic models and Direct Lake data consumption.
- Implement data quality checks, reconciliation, monitoring, and operational controls.
- Apply data governance and security standards involving Purview, RBAC, PII/PHI controls, classification, and lineage.
- Troubleshoot pipeline failures, performance issues, data discrepancies, and production incidents.
- Collaborate with Solution Architects, Lead Data Engineers, BI teams, and business stakeholders.
Requirements
- At least 5 years of overall data engineering experience with hands-on Azure or Microsoft Fabric experience.
- Strong hands-on experience with Microsoft Fabric Lakehouse, OneLake, Warehouse, Data Pipelines, and Notebooks.
- Proficiency in Spark/PySpark, Python, SQL, and Delta Lake.
- Experience with ETL/ELT, CDC, data ingestion, data transformation, and Medallion Architecture.
- Experience developing data quality, validation, reconciliation, and exception-handling frameworks.
- Knowledge of Power BI semantic models and Direct Lake.
- Experience with Microsoft Purview, Azure DevOps, Git, CI/CD, and deployment.
- Commercial insurance or brokerage data experience is preferred.
Categories
Data Engineering
About EXL
EXL provides data analytics, AI, and digital operations services for enterprises in insurance, healthcare, banking, and other regulated industries. It delivers consulting, managed services, and technology platforms to improve decision-making, risk management, and operational efficiency. Founded in 1999 and headquartered in New York, EXL is a public company listed on the NASDAQ (ticker: EXLS).