2 days ago
Kolkāta, India +5 moreStaff+
Responsibilities
- Architect the data platform blueprint and implement relevant platform components in collaboration with Integration Architects and Data Architects.
- Lead enterprise-scale lakehouse initiatives as a Data Architect and Data Engineer.
- Design and build scalable ETL/ELT pipelines using Python, PySpark, Delta Lake, Auto Loader, Delta Live Tables, and Asset Bundles.
- Architect data ingestion, transformation, reusable pipeline components, Databricks Functions, and DLT Expectations.
- Implement and govern Unity Catalog, including catalogs, schemas, role-based access, lineage, classification tagging, SSO, audit logging, external locations, and volume access.
- Enable Lakehouse Federation, Databricks Marketplace integrations, and Delta Sharing for secure cross-platform and external data access.
- Design PII anonymization, tokenization, and masking strategies to support GDPR and HIPAA compliance.
- Architect Databricks integrations with Power BI, Tableau, and Looker, and build Databricks SQL Dashboards for real-time reporting and KPI tracking.
- Lead cross-functional delivery across data science, analytics, and platform teams and provide thought leadership on Mosaic AI, Vector Search, Model Serving, and Marketplace publishing.
- Provide delivery and solution leadership, client leadership, execution ownership, and people development.
Requirements
- At least 12 years of professional experience.
- 15 years of full-time education.
- Expertise with the Databricks Unified Data Analytics Platform.
- Proven experience as a Data Architect and Data Engineer leading enterprise-scale lakehouse initiatives.
- Expert understanding of Data Mesh, Data Products, Lakehouse Architecture, data modeling, and data warehousing.
- Strong Python programming and debugging skills and strong PySpark experience.
- Hands-on expertise with at least one of AWS, GCP, or Azure.
- Experience with Unity Catalog, Databricks governance, secure data sharing, and platform performance optimization.
- Knowledge of DBT, machine learning concepts, big data processing, data orchestration, cloud DevOps practices, and ETL tools is preferred.
- Databricks Professional or similar certification is preferred.
- Experience with Spark, Hadoop, Hive, Kafka, Apache Airflow, Informatica, Talend, Matillion, or Fivetran is preferred.
Tech Stack
Apache AirflowApache HadoopApache HiveApache KafkaApache SparkAWSAzureDatabricksdbtGoogle Cloud PlatformInformaticaPythonTalend
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.