Lead Data Engineer
Providence2 months ago
Hyderābād, IndiaStaff+
Responsibilities
- Engineer, develop, and support enterprise data archival, electronic data conversion, data warehouse, and Azure data services across their full lifecycles.
- Build and manage ETL/ELT processes using Azure data services, Databricks, Python, Spark, and SQL.
- Integrate structured and unstructured data from systems including SailPoint, ServiceNow, Project Online, ADO, Intune, and Azure licensing platforms.
- Create APIs, API governance standards, and bi-directional integrations that establish a single source of truth.
- Develop, monitor, and manage report curation, data modeling, data analysis, and Power BI visualizations.
- Develop and maintain microservice automation using Prisma Cloud and Kubernetes.
- Gather requirements, perform data analysis and modeling, create enhancement scripts, and implement solutions across Microsoft endpoint technologies.
- Collaborate with service teams, external vendors, data warehouse teams, reporting teams, and stakeholders on priorities, integrations, data integrity, and reporting needs.
Requirements
- 6–9 years of experience in Azure data engineering.
- 6–9 years of experience in BI development.
- 6–9 years of experience with cloud technologies such as Azure, AWS, or Google Cloud services.
- Strong knowledge of SQL, Azure SQL, T-SQL, databases, data warehouses, and data analysis.
- Experience with Databricks, Apache Spark, Python, Microsoft Fabric, and data visualization.
- Experience writing C# or similar-language scripts for API development.
- Experience with Azure Data Factory, Azure Workbooks, Log Analytics, Azure Functions, Azure Storage, Logic Apps, Azure SQL SaaS, Runbooks, Automation, and Graph API.
- Experience developing and maintaining microservice automation with Prisma Cloud and Kubernetes.
- Ability to troubleshoot technical problems, solve problems, communicate effectively, and collaborate with global teams in Agile sprints.
- Bachelor’s degree in Computer Science, Data Analytics, Business Management, or Information Systems.
Tech Stack
Categories
Data Engineering
About Providence
Providence is a nonprofit Catholic health system that operates hospitals, clinics, and related care services for patients and communities across the western U.S. It runs 51 hospitals and 829 clinics and also offers a health plan in select markets. Headquartered in Renton, Washington, Providence provides acute, ambulatory, virtual, and home-based care along with pharmacy and behavioral health services, supported by centralized technology, cybersecurity, and shared services teams.