
EY - GDS Consulting - AI and DATA - AWS Data Engineer - Senior
Ernst and Young2 days ago
Kolkāta, IndiaSenior / Staff+
Responsibilities
- Design, deploy, and manage cloud-native AWS solutions using Glue, Lambda, S3, DynamoDB, Lake Formation, Athena, Redshift, and RDS.
- Build scalable, secure, and governed data lakes using S3 and Iceberg for analytics and reporting.
- Implement event-driven workflows with Lambda, SNS, and EventBridge for automation and real-time processing.
- Develop APIs and integrate distributed services for backend systems and client applications.
- Monitor, troubleshoot, and optimize infrastructure using CloudWatch and Grafana dashboards.
- Automate deployments with CI/CD pipelines and infrastructure-as-code frameworks.
- Participate in analysis, design, development, testing, production deployment, and support across the data solution lifecycle.
- Collaborate with cross-functional teams on best practices, security compliance, and business alignment.
- Mentor junior engineers and support knowledge-sharing across teams.
- Manage client relationships and contribute to consulting delivery.
Requirements
- Computer science graduate or equivalent.
- 5–10 years of industry experience.
- Hands-on experience designing and implementing AWS cloud infrastructure at scale.
- Expertise in data lakes, governance, and analytics using AWS Lake Formation, S3, Athena, and Iceberg.
- Strong understanding of serverless architectures and event-driven workflows using Lambda, SNS, and EventBridge.
- Strong knowledge of AWS Redshift, Amazon RDS, DynamoDB, data modeling, and query optimization.
- Proficiency in Python or Bash for cloud automation and workflow scripting.
- Experience developing APIs and integrating distributed systems in cloud environments.
- Experience configuring and monitoring cloud infrastructure using CloudWatch and Grafana.
- Working knowledge of CI/CD pipelines, DevOps practices, Terraform, CloudFormation, or AWS CDK.
- Understanding of Parquet, ORC, and AVRO storage formats.
- Familiarity with IAM policies, encryption, security frameworks, and data protection practices.
- Experience working with structured and unstructured data in batch and streaming pipelines.
- Strong troubleshooting, performance-tuning, problem-solving, communication, adaptability, and ownership skills.
- Experience with deployment processes and containerization is a plus.
- Experience with Agile-based delivery methodology is preferable.
- Client management skills are ideally preferred.
Benefits
- Support, coaching, and feedback from experienced colleagues.
- Opportunities to develop new skills and progress your career.
- Education, coaching, practical experience, and an individual progression plan.
- Interdisciplinary work emphasizing quality and knowledge exchange.
- Freedom and flexibility to handle the role in a way that suits the employee.
Categories
BackendData Engineering
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.