1 day ago
Pune, India or Bengaluru, IndiaStaff+
Responsibilities
- Design and develop scalable data engineering solutions using Databricks, PySpark, and Spark SQL.
- Build and support real-time data streaming solutions using Apache Kafka.
- Develop and maintain Kafka producers, consumers, Kafka Streams, Kafka Connect, and integration frameworks.
- Design and implement batch and streaming data pipelines for large-scale processing.
- Work with Delta Lake, Lakehouse architecture, data modeling, data warehousing, and enterprise data platforms.
- Optimize data ingestion, transformation, and processing workloads for performance and scalability.
- Collaborate with architects, business stakeholders, and development teams to deliver end-to-end data solutions.
- Support cloud-native implementations on Azure and participate in CI/CD and DevOps practices.
- Ensure data quality, security, monitoring, and operational excellence across data platforms.
- Provide technical leadership, mentor team members, and drive solution best practices.
Requirements
- At least 12 years of experience.
- 15 years of full-time education.
- Strong expertise in Apache Kafka, Kafka Streams, and Kafka Connect.
- Experience with Databricks, PySpark, Spark SQL, Delta Lake, and Lakehouse architecture.
- Knowledge of real-time data processing and event-driven architecture.
- Knowledge of data modeling and data warehousing concepts.
- Experience with Azure cloud services, CI/CD, Git, and DevOps practices.
- Strong analytical, troubleshooting, and stakeholder management skills.
Tech Stack
Categories
BackendData Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.