3 days ago
Pune, IndiaMid Level
Responsibilities
- Develop and support enterprise production data pipelines.
- Build ETL pipelines and batch-processing workflows.
- Use Python, PySpark, Spark SQL, Databricks, Azure, ADLS, Delta Lakes, and lakehouse architecture.
- Apply Spark partitioning, caching, distributed processing, performance enhancement, and exception-handling techniques.
- Work with Terraform/IaC for production data infrastructure.
- Support data engineering projects for banking, insurance, payment services, and energy clients.
Requirements
- Experience with Python, PySpark, Spark SQL, Databricks, and Azure.
- Knowledge of Spark fundamentals, including partitioning, caching, distributed processing, performance enhancement, and exception handling.
- Experience with batch processing, ADLS, ETL pipelines, Delta Lakes, and lakehouse architecture.
- Experience with Terraform/IaC and enterprise production pipeline development and support.
Benefits
- Work on transformation projects for major international and local banks, insurance companies, payment service providers, and energy-sector clients.
- Open, inclusive, and flexible culture with opportunities for career advancement.
Tech Stack
Categories
Data Engineering
About Capco
Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.