20 days ago
Pune, IndiaSenior
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes.
- Integrate and unify database systems, APIs, external cloud platforms, and internal data sources.
- Develop and optimize data architectures and transformation technologies for analytical needs.
- Manage and optimize databases for performance, scalability, and availability.
- Identify and resolve bottlenecks in data processing and optimize database and pipeline performance.
- Implement monitoring and logging solutions to address data reliability and quality issues.
- Ensure data governance and security policies are followed.
- Collaborate with data scientists, analysts, business partners, and non-technical stakeholders.
- Coach junior team members.
Requirements
- At least 12 years of experience is required; the posting also states 8 years of expected experience.
- Strong data engineering experience, including data warehousing and data modeling.
- Proficiency in AWS services, Python, and SQL.
- Experience with database management systems, including SQL and NoSQL databases.
- Experience with Kafka and big data technologies such as Hadoop and PySpark.
- Experience with data warehousing solutions such as Snowflake, Redshift, and BigQuery.
- Experience with DevOps tools including GitLab, Docker, and Kubernetes.
- Strong analytical and problem-solving skills.
- Ability to work independently and collaboratively and communicate with non-technical stakeholders.
- 15 years of full-time education.
Tech Stack
Amazon RedshiftApache HadoopApache KafkaAWSDockerGoogle BigQueryKubernetesMongoDBPostgreSQLPythonSnowflakeSQL
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.