Capco

Lead Big Data Engineer

Capco
Apply
10 days ago
Pune, IndiaStaff+

Responsibilities

  • Design and implement end-to-end data warehouse, data lake, and lake house solutions in petabyte-scale big data environments.
  • Build complex data pipelines using Spark with Scala, Python, or Java on Hadoop or object storage.
  • Work with Oracle and Netezza databases and apply strong SQL skills.
  • Create user stories with well-defined acceptance criteria and participate in sprint planning and reviews.
  • Debug production issues, identify root causes, and implement mitigation plans.
  • Communicate effectively with clients and project stakeholders in written and verbal formats.

Requirements

  • 9+ years of professional experience.
  • At least 5 years of experience working on data warehouse, data lake, or lake house projects.
  • Expertise in data engineering and implementing multiple end-to-end data warehouse projects in big data environments.
  • Experience building complex Spark pipelines with Scala, Python, or Java on Hadoop or object storage.
  • Experience with Oracle, Netezza, and strong SQL knowledge.
  • Strong analytical, verbal, and written communication skills.
  • Experience building NiFi pipelines is preferred.

Benefits

  • Work on transformation projects for major banking, insurance, payment services, and energy organizations.
  • Open and inclusive culture emphasizing diversity, creativity, and collaboration.
  • Career advancement opportunities without a forced hierarchy.
  • Location options include Pune, Bengaluru, Gurugram, Chennai, Hyderabad, and Mumbai.

Tech Stack

Apache HadoopApache SparkJavaPythonScalaSQL

Categories

Data Engineering
Capco

About Capco

5,001-10,000 employees

Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.

Contact me