2 months ago
Pune, India or Bengaluru, IndiaMid Level
Responsibilities
- Design, develop, and maintain data solutions for data generation, collection, and processing.
- Build and optimize end-to-end ETL pipelines using AWS Step Functions, EventBridge, Glue, PySpark, SQL scripts, and Lambda.
- Migrate and transform high-volume data from legacy on-premises systems to AWS.
- Implement error handling, retry mechanisms, data quality validation, and incremental loads.
- Monitor and troubleshoot pipelines using CloudWatch and optimize workflows for cost, performance, and scalability.
- Collaborate with solution designers, DevOps engineers, and multiple teams on testing, deployment, and technical decisions.
- Document code and solutions for team handover.
Requirements
- At least 3 years of experience with AWS Glue and PySpark.
- Proficiency in SQL, ETL, Unix, Iceberg, Astronomer, and data warehousing concepts.
- Strong understanding of data pipeline architecture and design principles.
- Experience with data warehousing solutions and ETL processes.
- Familiarity with cloud computing services and data storage solutions.
- Ability to troubleshoot and optimize data workflows for performance.
- 15 years of full-time education.
Benefits
- Position based at the Pune office.
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.