9 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services.
- Use Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric, Azure Data Lake Storage Gen 2, and Azure Blob Storage for data processing and storage.
- Optimize Azure data pipelines for performance, scalability, and reliability.
- Ensure data quality and integrity through validation techniques and frameworks.
- Monitor and troubleshoot data pipeline and workflow issues.
- Develop and maintain documentation for data processes, configurations, and best practices.
- Manage the CI/CD process for deploying and maintaining data solutions.
- Lead the design and implementation of scalable data architectures and continuously improve data processing workflows.
- Collaborate with data scientists, data analysts, data architects, and other stakeholders to deliver data solutions.
- Act as a subject matter expert, contribute to team decisions, manage business needs, and provide solutions across multiple teams.
- Mentor junior team members and support knowledge sharing.
Requirements
- At least 3 years of experience is stated for the project role, with additional information requiring a minimum of 5 years of Data Engineering experience.
- 15 years of full-time education is required.
- Proficiency in Data Engineering, Data Architecture Principles, Databricks Unified Data Analytics Platform, and Microsoft Azure Data Services.
- Strong experience building and optimizing data pipelines and ETL frameworks.
- In-depth knowledge of cloud-based data storage and processing solutions.
- Ability to work with large datasets and maintain data quality and consistency.
- Experience monitoring and troubleshooting data workflows.
- Python experience is preferred; Scala, Java, or C# experience is also accepted.
- Experience building Spark applications with PySpark.
- Technical leadership, consulting, business-needs management, and learning agility.
Benefits
- The position is based at the Accenture office in Pune.
Tech Stack
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.