2 days ago
Kolkāta, India +8 moreSenior
Responsibilities
- Architect and implement enterprise-scale Databricks data platforms and lakehouse solutions.
- Design scalable and modular ETL/ELT pipelines using PySpark, Delta Lake, Auto Loader, Delta Live Tables, and Asset Bundles.
- Architect data ingestion, transformation, reusable pipeline components, and DLT Expectations.
- Lead Unity Catalog implementation, including catalogs, schemas, role-based access, lineage, classification tags, workspace linkage, SSO, audit logging, external locations, and volume access.
- Govern data sharing, Lakehouse Federation, Databricks Marketplace assets, and secure cross-tenant or external dataset access.
- Design PII anonymization, tokenization, and masking strategies aligned with GDPR and HIPAA requirements.
- Integrate Databricks with Power BI, Tableau, and Looker, and build Databricks SQL dashboards for reporting, KPIs, alerts, and real-time insights.
- Lead cross-functional delivery across data science, analytics, and platform teams.
- Provide thought leadership on Mosaic AI, Vector Search, Model Serving, Marketplace publishing, performance optimization, and data products.
- Provide client leadership, execution ownership, architectural guidance, and people development.
Requirements
- At least 7.5 years of experience.
- 15 years of full-time education.
- Expertise with the Databricks Unified Data Analytics Platform.
- Proven experience as a Data Architect and Data Engineer leading enterprise-scale lakehouse initiatives.
- Expert-level knowledge of Data Mesh, Data Products, Lakehouse Architecture, data modeling, and data warehousing.
- Strong Python programming and debugging skills and extensive PySpark experience.
- Hands-on expertise with at least one of AWS, GCP, or Azure.
- Experience with Unity Catalog, Delta Lake, Delta Live Tables, Lakehouse Federation, Delta Sharing, Databricks SQL, and Databricks governance features.
- Experience with cloud data engineering, storage, processing, warehousing, real-time streaming, and serverless services.
- Knowledge of GDPR, HIPAA, PII protection, data masking, tokenization, and anonymization.
- Experience integrating Databricks with Power BI, Tableau, and Looker.
- Preferred qualifications include Databricks certification, machine learning knowledge, Spark, Hadoop, Hive, Kafka, Apache Airflow, cloud DevOps practices, CI/CD, Informatica, Talend, Matillion, Fivetran, and dbt.
Tech Stack
Apache AirflowApache HadoopApache HiveApache KafkaApache SparkAWSAzureDatabricksdbtGoogle Cloud PlatformInformaticaPythonTalend
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.
