1 month ago
Hyderābād, IndiaSenior
Responsibilities
- Design and implement scalable data architectures and production-grade data pipelines.
- Build and manage ETL/ELT pipelines for batch and large-scale data processing.
- Implement Medallion Architecture across Bronze, Silver, and Gold data layers.
- Develop transformation frameworks, optimize Spark workloads, and improve performance and cost efficiency.
- Implement data quality validation, monitoring, and production pipeline troubleshooting.
- Collaborate with cross-functional teams and data architects to translate business requirements into enterprise-grade data solutions.
- Coordinate data workflow optimization and contribute to decisions across multiple teams.
- Act as a subject matter expert, manage team activities, make team decisions, and mentor junior team members.
Requirements
- At least 5 years of Data Engineering experience.
- Strong hands-on expertise with Databricks, Python, PySpark, and SQL.
- Experience designing and building scalable, production-grade data pipelines.
- Deep understanding of ETL/ELT design patterns and large-scale data processing.
- Experience implementing Medallion Architecture across Bronze, Silver, and Gold layers.
- Knowledge of data storage solutions, database management, cloud data platforms, distributed computing, and data quality monitoring.
- Ability to design and deliver maintainable, scalable data solutions independently.
- Preferred experience with Microsoft Azure services including ADF, ADLS, and Synapse; or GCP services including BigQuery, GCS, and Dataflow.
- Preferred knowledge of data governance, Delta Lake, Lakehouse Architecture, data lineage, and metadata management.
- Bonus experience with AI, GenAI, large language models, agentic AI, canonical data models, and AI–data platform integration.
- 15 years of full-time education is required.
Benefits
- The position is based at the Accenture Hyderabad office.
Tech Stack
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.