1 month ago
Pune, IndiaSenior
Responsibilities
- Design, develop, and maintain data solutions for data generation, collection, processing, migration, and deployment.
- Create scalable data pipelines and implement ETL/ELT and streaming processes.
- Build and operate scalable lakehouse pipelines on Databricks and Azure.
- Own Delta Lake optimization, Unity Catalog governance, CI/CD, data integration, and data quality.
- Integrate ADLS, ADF, and Synapse to deliver high-quality datasets for BI, ML, and GenAI.
- Lead efforts to identify and resolve data-related challenges and optimize workflows for performance and cost efficiency.
- Serve as an SME, manage and coordinate team activities, and contribute to decisions across multiple teams.
- Mentor junior team members and coordinate cross-functional data engineering initiatives.
Requirements
- At least 5 years of experience with Microsoft Azure Databricks.
- Proficiency in PySpark, SQL, Databricks, Delta Lake, DLT/Workflows, Azure data services, Unity Catalog, and CI/CD.
- Experience building scalable and reliable cloud-based data pipelines.
- Strong knowledge of data integration techniques and ETL process design.
- Familiarity with data storage solutions and data warehousing concepts.
- Experience troubleshooting and resolving complex data processing issues.
- Knowledge of MLflow/Feature Store, Power BI, streaming/CDC, vector search/RAG, and Terraform.
- 15 years of full-time education.
Benefits
- The position is based at the Pune office.
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.