21 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services.
- Build and optimize scalable data architectures and data processing workflows for performance, reliability, and cost effectiveness.
- Use Azure Data Lake Storage Gen 2, Azure Blob Storage, and other Azure storage services to organize pipeline outputs.
- Implement data validation techniques and frameworks to ensure data quality, integrity, and consistency.
- Monitor and troubleshoot data pipeline and workflow issues to ensure timely resolution.
- Manage CI/CD processes for deploying and maintaining data solutions.
- Document data processes, configurations, and best practices.
- Collaborate with data scientists, data analysts, data architects, and other stakeholders to deliver data solutions.
- Lead technical decisions, provide solutions across multiple teams, and contribute to key organizational decisions.
- Oversee continuous improvement of data processing workflows and mentor junior team members.
Requirements
- At least 5 years of Data Engineering experience.
- 15 years of full-time education.
- Proficiency in Data Engineering, Data Architecture Principles, Databricks Unified Data Analytics Platform, and Microsoft Azure Data Services.
- Strong experience building and optimizing data pipelines and ETL frameworks.
- In-depth knowledge of cloud-based data storage and processing solutions.
- Ability to work with large datasets and ensure data quality and consistency.
- Familiarity with scripting and programming languages used in data engineering.
- Experience monitoring and troubleshooting data workflows.
- Python experience is preferred; Scala, Java, or C# experience is also accepted.
- Experience building Spark applications using PySpark.
- Technical leadership, business-needs consulting, team management, and learning agility.
Benefits
- The position is based at the Accenture Pune office.
Tech Stack
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.