2 days ago
Pune, India or Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and maintain data solutions for data generation, collection, and processing.
- Build end-to-end ETL pipelines using AWS Step Functions, EventBridge, AWS Glue, PySpark, SQL scripts, and Lambda.
- Migrate and transform high-volume data from legacy on-premises systems to AWS using error handling and retry mechanisms.
- Test pipelines for performance, deploy them with DevOps support, and monitor and troubleshoot workflows using CloudWatch.
- Optimize pipelines for cost, performance, and scalability, and document code for team handover.
- Support data-quality validation and incremental loads to maintain data integrity during data migration.
- Collaborate with solution designers, DevOps engineers, cross-functional teams, and multiple project teams to resolve data problems and make technical decisions.
Requirements
- At least 5 years of experience is required.
- At least 5 years of experience with PySpark and AWS Glue is required.
- Proficiency in AWS Glue, PySpark, SQL, Unix, Iceberg, Astronomer, and data warehousing concepts.
- Strong understanding of data pipeline architecture and design principles.
- Experience with data warehousing solutions and ETL processes.
- Familiarity with cloud computing services and data storage solutions.
- Ability to troubleshoot and optimize data workflows for performance.
- 15 years of full-time education is required.
Benefits
- The position is based at the Pune office.
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.