2 months ago
Pune, IndiaStaff+
Responsibilities
- Own the technical direction, architecture, design, and delivery of custom software and data engineering solutions.
- Lead and support teams in maintaining development standards, code quality, scalability, performance, and operational excellence.
- Design and implement batch, real-time, and near-real-time data platforms and pipelines using Azure Databricks and distributed processing technologies.
- Make technical decisions, provide solutions across multiple teams, and collaborate with DevOps and other stakeholders.
- Drive continuous improvement in software development processes and team productivity.
- Mentor and support junior team members and contribute as a subject matter expert.
Requirements
- At least 7.5 years of professional experience in software or data engineering; the posting also describes an 8–10 year data engineering profile.
- Bachelor’s degree or higher in Computer Science, Engineering, or Science, along with 15 years of full-time education.
- At least 5 years of experience with Microsoft Azure Databricks and 5+ years with Azure cloud-native services.
- Experience designing and implementing Azure Databricks big data solutions for batch and real-time analytics.
- Strong experience with Python or PySpark, Scala, SQL, Unix, Hive, Apache Spark, and distributed data platforms.
- Experience with streaming, event processing, data stores, workflow orchestration, performance optimization, monitoring, logging, data quality, security, and governance.
- Knowledge of Lakehouse, Delta Lake, Data Mesh, data virtualization, dimensional modeling, data aggregation, data warehouses, and Medallion Architecture.
- Familiarity with Azure Data Factory, ADLS Gen2, Azure SQL Database, Microsoft Fabric, and at least one workflow orchestration framework.
- Good-to-have experience with Power BI, Tableau, Apache Flink, Apache Kafka, and the ELK stack.
- Strong communication skills and the ability to collaborate effectively with globally distributed teams.
Benefits
- Position is based at the company’s Pune office.
Tech Stack
Apache AirflowApache FlinkApache HadoopApache HBaseApache HiveApache KafkaApache SparkAzureDatabricksElasticsearchKibanaLogstashPythonScalaSQL
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.