2 days ago
Pune, IndiaSenior
Responsibilities
- Design, develop, and improve digital products and technology services for clients and employees.
- Analyze user needs and develop new features using software engineering, automated testing, and deployment practices.
- Design and implement Azure-based data analytics, data warehouse, data lake, data mesh, and data integration solutions.
- Build and maintain data pipelines using Azure Data Factory, Azure Databricks, Spark, SQL, and orchestration tools.
- Ensure solution quality, security, reliability, compliance, and adherence to functional and non-functional requirements.
- Build observability into solutions, monitor production health, resolve incidents, and remediate root causes.
- Work with large and complex codebases using Git-based collaboration, pull requests, and CI/CD pipelines.
- Evaluate technologies and platforms with a focus on long-term sustainability and reusable standards.
Requirements
- A minimum of 8 years of experience as a Data Engineer and 8–10 years of hands-on data engineering experience are stated.
- Minimum 5 years of experience is required for the project role.
- Relevant bachelor’s degree or equivalent and 15 years of full-time education are required.
- High proficiency designing and developing data analytics and data warehouse solutions with Azure Data Factory, Azure Databricks, Azure Analytics services, Azure Data Lake Storage Gen2, Azure SQL or PostgreSQL, and Azure identity services.
- Experience designing large-scale data distribution, service-oriented integration, data mesh, data lake, and data analytics solutions using Azure data services.
- Proficiency with Spark using Python or Scala and with SQL.
- Hands-on experience with Linux or PowerShell scripting.
- Prior ETL development experience with tools such as Informatica, SSIS, or Talend; Kafka and Azure infrastructure knowledge are preferred.
- Experience with cloud platforms, preferably Microsoft Azure, in an agile SDLC environment using modern programming languages, DevOps practices, and test-driven development.
- Exposure to Docker and Git, plus experience with GitLab or GitHub, fork/pull workflows, and CI/CD pipelines.
- Experience with Apache Airflow, Autosys, or Control-M for pipeline orchestration; Apache Airflow is preferred.
- Knowledge of GitLab CI/CD pipeline creation, YAML, Terraform, ARM, Puppet, Azure Functions, and Azure Logic Apps is preferred.
- Experience working with Agile methodologies including Scrum, XP, or Kanban.
- Strong English communication skills for presentations and technical writing.
Benefits
- The position is based at the Pune Kharadi office and requires working from the office three days every week.
- The posting describes an equal employment opportunity policy covering protected characteristics.
Tech Stack
Apache AirflowApache KafkaApache SparkAzureDatabricksDockerGitInformaticaLinuxPostgreSQLPowerShellPuppetPythonScalaSQLTalendTerraform
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.