Data Engineer – Databricks & Lakehouse (Power BI Environment)
Hillenbrand, Inc.5 months ago
Remote, IndiaSenior
Responsibilities
- Design, develop, maintain, and optimize scalable data pipelines using Databricks and Delta Lake.
- Build and manage transformations across bronze, silver, and gold data layers.
- Develop gold-layer datasets and reusable data models aligned with standardized business definitions and reporting metrics.
- Integrate data from ERP, CRM, APIs, and other enterprise systems.
- Implement automated data quality checks, validation rules, and testable production-ready pipelines.
- Monitor pipeline performance, troubleshoot issues, and support high-volume workloads across development, test, and production environments.
- Support impact analysis using lineage tools, governance and cataloging efforts, and CI/CD deployment processes.
- Align Databricks outputs with Power BI semantic models and partner with BI and business teams.
- Document data models and pipelines and explore AI agents and AI-assisted tools for development, testing, lineage analysis, and optimization.
Requirements
- Bachelor’s degree in a relevant field.
- At least 8 years of data engineering experience.
- Strong experience with Databricks, Spark, and Delta Lake.
- Proficiency in SQL and Python.
- Experience with Power BI or similar tools.
- Preferred experience with Azure Data Factory, Synapse, or Data Lake.
- Preferred experience with DevOps, CI/CD, AI agents, AI-assisted development, and large, complex enterprise environments.
Tech Stack
Categories
Data Engineering
About Hillenbrand, Inc.
Hillenbrand builds and sells industrial processing equipment and automation systems for manufacturers in plastics, food, recycling, and other markets. Its portfolio includes brands such as Coperion, Milacron, and Mold-Masters, delivering extrusion, material handling, hot runner, and molding technologies, plus related software and services. The company is headquartered in Batesville, Indiana and is publicly traded on the NYSE (HI).