GDS Consulting_Senior Data Engineer
Ernst and Young23 hours ago
Cebu City, PhilippinesSenior
Responsibilities
- Design, build, and optimize scalable data pipelines using Databricks, PySpark, Python, and SQL.
- Develop ETL/ELT solutions and Lakehouse architectures using Delta Lake, Unity Catalog, Databricks Workflows, and Structured Streaming.
- Build and support Azure-based data platforms with Azure Data Factory and Azure Data Lake Storage Gen2.
- Optimize Spark workloads for performance, scalability, and cost efficiency in large-scale environments.
- Implement CI/CD and engineering best practices while supporting DataOps initiatives.
- Collaborate with business and technical stakeholders to deliver high-quality data solutions.
- Support data governance, data quality, and security initiatives.
- Mentor junior engineers and contribute to data engineering capability development.
Requirements
- At least 5 years of experience in data engineering.
- Strong hands-on Databricks experience and advanced proficiency in Python and SQL.
- Experience developing scalable data pipelines with PySpark and Databricks.
- Experience with Delta Lake, Unity Catalog, Databricks Workflows, and Structured Streaming.
- Experience with Azure Data Factory and Azure Data Lake Storage Gen2.
- Strong understanding of data modeling, ETL/ELT, and data warehousing concepts.
- Experience with CI/CD using Azure DevOps, GitHub, or Git.
- Experience optimizing Spark workloads in large-scale environments.
- Strong communication, problem-solving, stakeholder management, collaboration, ownership, and accountability skills.
- Preferred qualifications include Databricks Certified Data Engineer Associate or Professional certification, Microsoft Azure Data Engineer Associate certification, and experience with Microsoft Fabric, Snowflake, AWS, GCP, Terraform, AI/ML workloads on Databricks, or modern AI platforms.
Benefits
- Enterprise-scale Data and AI transformation projects.
- Exposure to current Databricks, Azure, AI, and Analytics technologies.
- Continuous learning and certification opportunities.
- Collaborative, inclusive, and high-performing culture.
- Clear career growth within EY GDS Consulting.
Tech Stack
Categories
Data Engineering
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.