18 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and automate scalable ELT pipelines using Python, SQL, and Apache Airflow.
- Extract and integrate data from REST APIs, relational databases, cloud applications, files, and third-party platforms.
- Load, optimize, and manage data in Snowflake for scalable and reliable analytics.
- Develop reusable DBT Cloud transformation models using Bronze, Silver, and Gold data layers.
- Implement data profiling, data quality rules, automated validation checks, source-to-target mappings, metadata management, and data lineage.
- Build metadata-driven ingestion frameworks with logging, monitoring, error handling, and end-to-end integrity validation.
- Develop and maintain Airflow DAGs for orchestration, scheduling, dependencies, and monitoring.
- Build CI/CD pipelines and manage source code using Azure DevOps, GitLab CI/CD, GitHub, and related repositories.
- Use GitHub Copilot, large language models, and prompt engineering to support development, testing, documentation, and troubleshooting.
- Collaborate with business stakeholders, data analysts, architects, DevOps engineers, and other teams on requirements and delivery.
- Lead software development planning and execution, contribute to team decisions, document technical solutions, and mentor junior team members.
Requirements
- At least 5 years of experience in Python programming.
- 15 years of full-time education.
- Advanced SQL development and query optimization skills.
- Hands-on experience with Apache Airflow and DBT Cloud.
- Strong knowledge of Snowflake, data warehousing, dimensional modeling, and ETL/ELT pipelines.
- Experience integrating data from APIs, relational databases, and external data sources.
- Experience implementing data profiling, data quality frameworks, validation rules, metadata management, and data lineage.
- Experience with CI/CD, GitHub, version control, code reviews, and collaborative development tools.
- Familiarity with GitHub Copilot, LLM-based development tools, and prompt engineering.
- Strong software architecture, analytical, debugging, communication, stakeholder management, and documentation skills.
- Experience with Oracle PLSQL is preferred.
- Experience with Data Build Tool is preferred.
- Experience with scalable and maintainable software development practices is preferred.
Benefits
- The position is based at the Accenture Bengaluru office.
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.