EY - GDS Consulting - AI And DATA - Data Engineer - Senior
Ernst and Young17 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design and build production-grade data pipelines using Azure Data Factory and Azure Databricks.
- Develop scalable data architectures using Azure SQL, Data Lake, and star or snowflake schemas.
- Implement data quality validation and reconciliation processes and resolve operational issues.
- Use Python for data processing, transformation, and analytics.
- Maintain Jupyter Notebooks for exploration and experimentation and use MLflow for experiment tracking and model lifecycle management.
- Deliver curated analytics-ready datasets for Power BI and other reporting platforms.
- Optimize data models for reporting, dashboarding, and analytics consumption.
- Implement CI/CD pipelines for data engineering workflows and secure data handling practices.
- Monitor, troubleshoot, and resolve pipeline failures and performance issues.
Requirements
- 5–8+ years of experience in data engineering.
- Strong expertise in Azure Data Factory, Azure Databricks, Azure SQL, and Data Lake.
- Solid understanding of data modeling, including star and snowflake schemas.
- Experience building scalable and reliable data pipelines.
- Strong problem-solving and analytical skills and the ability to manage production-grade data environments.
- Focus on data quality, scalability, and performance optimization.
- Experience in regulated data environments is preferred.
- Exposure to Azure OpenAI or AI/ML use cases is preferred.
- Knowledge of prompt engineering, evaluation frameworks, and experimentation techniques is preferred.
Benefits
- Continuous learning opportunities, tools, and flexibility to support career development and meaningful impact.
- Coaching, leadership development, and access to EY's global learning and skills ecosystem.
- Diverse and inclusive culture with opportunities to collaborate across EY teams, service lines, geographies, and sectors.
- The role is part of EY Global Delivery Services, which operates across Argentina, China, India, the Philippines, Poland, and the UK.
Tech Stack
Categories
Data Engineering
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.