3 days ago
Pune, IndiaSenior
Responsibilities
- Develop and support enterprise production data pipelines.
- Build ETL pipelines using Python, PySpark, Spark SQL, Databricks, and Azure.
- Implement batch processing with ADLS, Delta Lakes, and lakehouse architecture.
- Apply Spark partitioning, caching, distributed processing, performance enhancement, and exception handling.
- Use Terraform/IaC for infrastructure and support production delivery.
- Work on data engineering projects for banking, insurance, payments, and energy-sector clients.
Requirements
- Experience with Python, PySpark, Spark SQL, Databricks, and Azure.
- Knowledge of Spark fundamentals including partitioning, caching, distributed processing, performance enhancement, and exception handling.
- Experience with batch processing, ADLS, ETL pipelines, Delta Lakes, and lakehouse architecture.
- Experience with Terraform/IaC and enterprise production pipeline development and support.
- Familiarity with REST APIs and production delivery practices.
Benefits
- Engaging projects with major international and local banks, insurance companies, payment providers, and other key industry clients.
- Open, tolerant, inclusive culture that values diversity, creativity, and different perspectives.
- Career advancement opportunities without a forced hierarchy.
About Capco
Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.