Senior Consultant - Business Consulting Risk - GCP Data Engineer - Pyspark -FSRM - Pune/Hyderabad
Ernst and Young16 days ago
Mumbai, IndiaSenior
Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark and Google Cloud Platform services.
- Build and optimize ETL/ELT processes for large volumes of structured and unstructured data.
- Use BigQuery, Dataproc, Cloud Storage, Dataflow, Pub/Sub, Composer, and Cloud Functions for cloud data engineering.
- Perform data ingestion, transformation, cleansing, and validation.
- Collaborate with business, analytics, and engineering teams to understand requirements and deliver data solutions.
- Implement performance tuning, monitoring, and troubleshooting for data pipelines.
- Ensure data quality, governance, security, and compliance standards.
- Participate in Agile development practices, code reviews, and CI/CD implementation.
Requirements
- At least 5 years of data engineering experience.
- Strong hands-on experience with Python and PySpark.
- Experience with Google Cloud Platform, especially BigQuery, Dataproc, Cloud Storage, Dataflow, and Pub/Sub.
- Strong SQL skills and experience with large-scale data processing.
- Knowledge of ETL frameworks, data modeling, and data warehousing concepts.
- Experience with Git, Jenkins or GitHub Actions, and CI/CD pipelines.
- Strong problem-solving and stakeholder communication skills.
- Ability to work collaboratively across client departments while following commercial and legal requirements.
Benefits
- Training, learning resources, personalized career development, and access to EY career frameworks.
- Inclusive workplace focused on career growth and employee wellbeing.
- Work location in Pune or Hyderabad.
Tech Stack
Categories
Data Engineering
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.