7 days ago
Bengaluru, IndiaSenior
Responsibilities
- Gather, analyze, and document business and technical data requirements with stakeholders.
- Perform data profiling and implement data quality rules and automated validation checks.
- Design, develop, and automate ELT pipelines using Python, SQL, and Apache Airflow.
- Extract data from source systems, including relational databases, cloud applications, files, and third-party platforms.
- Load, optimize, and manage scalable data assets in Snowflake.
- Develop reusable dbt Cloud transformation models using Bronze, Silver, and Gold layers.
- Build metadata-driven ingestion frameworks with logging, monitoring, and error handling.
- Develop and maintain Airflow DAGs for orchestration, scheduling, dependencies, and monitoring.
- Build CI/CD pipelines using Azure DevOps and GitLab CI/CD.
- Manage source code using GitHub, Azure DevOps Repos, and GitLab.
- Use GitHub Copilot, large language models, and prompt engineering to support development, testing, documentation, and troubleshooting.
- Document technical designs, pipeline logic, transformation rules, and operational procedures.
- Collaborate across data, architecture, DevOps, and business teams; contribute to decisions and mentor junior team members.
Requirements
- At least 3 years of overall experience is required.
- At least 5 years of experience with Python is stated as an additional requirement.
- 15 years of full-time education is required.
- Proficiency in Python, SQL, data warehousing, and ETL/ELT is required.
- Hands-on experience with Apache Airflow, Snowflake, data transformation, data modeling, and scalable pipeline development is required.
- Experience with dbt Cloud, data profiling, data quality frameworks, source-to-target mapping, metadata management, and data lineage is required or preferred.
- Experience integrating REST APIs, relational databases, and external data sources is required or preferred.
- Experience with PLSQL is a good-to-have qualification.
- Knowledge of software development lifecycle practices, version control, collaborative development tools, debugging, and software architecture is required or preferred.
- Familiarity with GitHub Copilot, LLM-based development tools, and prompt engineering is preferred.
- Strong analytical, problem-solving, communication, stakeholder management, and documentation skills are required.
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.