4 days ago
Pune, India +4 moreSenior
Responsibilities
- Build and implement end-to-end data warehouse, data lake, and lake house projects in big data environments.
- Design complex data pipelines using Spark with Scala, Python, or Java on Hadoop or object storage.
- Work with Oracle and Netezza databases and apply strong SQL skills.
- Participate in Agile/Scrum activities including user-story creation, sprint planning, and sprint reviews.
- Debug production issues, determine root causes, and implement mitigation plans.
Requirements
- At least 5 years of experience in data warehouse, data lake, or lake house projects within a product- or service-based organization.
- Expertise in data engineering and delivery of multiple end-to-end data warehouse projects at petabyte scale.
- Strong experience with Spark and Scala, Python, or Java in Hadoop or object-storage environments.
- Experience with Oracle and Netezza databases and strong SQL knowledge.
- Strong analytical, verbal, and written communication skills.
- Experience building NiFi pipelines is preferred.
Benefits
- Position is based in Pune.
Tech Stack
Categories
Data Engineering
About Capco
Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.