22 hours ago
Kolkāta, India +3 moreSenior
Responsibilities
- Design, build, and maintain scalable production ETL/ELT pipelines across Azure, Databricks, and SAP source systems.
- Develop and optimize Databricks notebooks and jobs, Delta Lake tables, and Unity Catalog permissions for BI and AI/ML workloads.
- Integrate SAP S/4HANA, SAP Datasphere, and other enterprise applications using Azure Data Factory, Microsoft Fabric, or equivalent orchestration tools.
- Implement data-quality checks, monitoring, observability, and alerting for data pipelines.
- Build curated datasets and semantic models supporting Power BI reporting, KPIs, and single-source-of-truth dashboards.
- Define and implement enterprise data-integration patterns and reference architectures with data architects and senior engineers.
- Write tested, version-controlled code and participate in code reviews and CI/CD practices for data pipelines.
- Troubleshoot production issues, participate in on-call or escalation rotations as needed, and document root causes and corrective actions.
- Collaborate with analytics engineers and business teams in a Hub & Spoke data organization to promote reusable data-product standards.
- Mentor junior data engineers on coding standards, pipeline design, troubleshooting, and platform conventions.
- Provide recommendations on Azure, Microsoft Fabric, Databricks, and broader data-engineering capabilities.
Requirements
- Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field.
- 8+ years of experience in data engineering, ETL/ELT development, or a related data-platform engineering role.
- Hands-on experience building and operating Azure Data Factory and Databricks pipelines using Python, PySpark, and/or Spark SQL, including Delta Lake table design.
- Experience designing and maintaining enterprise cloud data pipelines with attention to cost, performance, reliability, and scalability.
- Experience supporting BI and AI/ML data needs, including Power BI datasets and feature pipelines for model training.
- Strong SQL and Python skills with experience in version control, testing, code review, and CI/CD.
- Working knowledge of Azure Data Lake, Azure Data Factory, Azure Databricks, Microsoft Fabric, or comparable cloud services.
- Knowledge of Databricks or modern lakehouse platforms, Delta Lake, and Unity Catalog or similar access-control tooling.
- Experience with Power BI, enterprise analytics, semantic models, dimensional modeling, star schemas, and data-integration patterns.
- Working knowledge of data governance, data quality, monitoring, and observability practices.
- Preferred experience with SAP S/4HANA and SAP Datasphere data extraction.
- Preferred experience in manufacturing, supply chain, life sciences, healthcare, or another regulated industry.
- Ability to collaborate across US and global time zones and work within a Hub & Spoke or federated data organization.
- Advanced degree is preferred.
- Strong communication, engineering judgment, continuous-improvement mindset, and ability to deliver reliable pipelines in a fast-paced environment.
About Embecta
Embecta designs and manufactures insulin-delivery devices—primarily pen needles and syringes—for people living with diabetes, distributing through pharmacies, hospitals, and healthcare channels in over 100 countries. Formed in 2022 as a spin-off from Becton, Dickinson and Company (BD), the public company is headquartered in Parsippany, New Jersey. It builds on a century of diabetes care heritage, with tens of millions of patients using its products worldwide.