1 day ago
Pune, IndiaSenior
Responsibilities
- Build and operate scalable lakehouse pipelines on Azure Databricks.
- Develop ELT, streaming, and CDC data pipelines and optimize Delta Lake workloads.
- Implement Unity Catalog governance, CI/CD, and integrations with ADLS, ADF, and Synapse.
- Deliver high-quality data sets for BI, machine learning, and generative AI use cases.
- Serve as a subject-matter expert, make team decisions, and provide solutions across multiple teams.
- Collaborate with cross-functional teams and manage team execution.
- Mentor junior team members and improve development processes.
Requirements
- At least 7.5 years of experience with Microsoft Azure Databricks.
- Proficiency in PySpark, SQL, Databricks Delta, DLT/Workflows, Azure data services, Unity Catalog, MLflow/Feature Store, Power BI, streaming/CDC, vector search/RAG, and Terraform.
- Experience with programming languages such as Python, Java, or Scala.
- Familiarity with data engineering concepts and data pipeline development.
- Experience with cloud platforms such as AWS or Google Cloud is preferred.
- Strong understanding of software development methodologies, Agile practices, and DevOps.
- 15 years of full-time education.
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.