1 day ago
Bengaluru, IndiaStaff+
Responsibilities
- Own technical delivery of Azure Databricks engagements from solution design through build, testing, deployment, go-live, and post-go-live stabilization.
- Lead and mentor data engineers and guide technical design, code quality, engineering practices, and implementation decisions.
- Translate solution architecture into detailed technical designs and implementation plans in collaboration with architects and project or program managers.
- Build and review Azure Databricks pipelines and components including Lakehouse, Delta Lake, Unity Catalog, Databricks SQL, Workflows, and Azure integrations.
- Drive coding, CI/CD, testing, performance optimization, data governance, and security standards across delivery teams.
- Troubleshoot complex technical issues, handle production support escalations, and contribute to reusable delivery accelerators and best practices.
- Track delivery progress, risks, and dependencies; support project estimation and provide technical input for upcoming phases.
- Work directly with project and program managers and client technical teams during delivery.
Requirements
- 10–12 years of experience in data engineering or technical delivery roles with strong recent hands-on Azure Databricks delivery experience.
- Deep hands-on expertise with Databricks Lakehouse, Delta Lake, Unity Catalog, Databricks SQL, Workflows, and cluster or compute optimization.
- Strong grounding in data lake and data warehouse architecture, including medallion architecture and dimensional modeling.
- Experience leading or contributing technically to data migration projects from legacy on-premises or cloud platforms to Azure Databricks.
- Experience with Azure Data Factory, Azure Synapse Analytics, ADLS Gen2, Azure SQL, SQL, data modeling, performance tuning, Spark, and PySpark.
- Working knowledge of data governance and security practices including role-based access and data lineage.
- Proven experience leading delivery teams through technical mentoring, code and design reviews, and hands-on problem-solving.
- Preferred qualifications include at least three years of hands-on Azure Databricks experience and Databricks Certified Data Engineer Professional or Databricks Certified Associate Developer for Apache Spark certification.
- Preferred experience includes Azure DevOps, GitHub Actions, MLflow, Databricks Model Serving, GenAI or agentic data use cases, multiple industry domains, and global distributed delivery environments.
Tech Stack
Categories
Data Engineering
About Avanade
Avanade is the world’s leading expert on Microsoft. Trusted by over 7,000 clients worldwide, we deliver AI-driven solutions that unlock the full potential of people and technology, optimize operations, foster innovation and drive growth. As Microsoft’s Global SI Partner we combine global scale with local expertise in AI, cloud, data analytics, cybersecurity, and ERP to design solutions that prioritize people and drive meaningful impact. We champion diversity, inclusion, and sustainability, ensuring our work benefits society and business.