Concentrix

Data Engineer

Concentrix
Apply
4 days ago
Bengaluru, IndiaMid Level / Senior

Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks, PySpark, Python, and SQL.
  • Build and optimize batch and large-scale data-processing solutions with Apache Spark.
  • Develop ingestion and transformation workflows for structured and semi-structured data using Delta Lake.
  • Perform data cleansing, validation, reconciliation, and quality checks.
  • Optimize Spark jobs, Databricks notebooks, SQL queries, clusters, and pipelines for performance and cost efficiency.
  • Troubleshoot pipeline failures, data-quality issues, production incidents, and performance bottlenecks.
  • Implement incremental processing, partitioning, caching, join optimization, and file-management techniques.
  • Develop reusable and configurable data-engineering components.
  • Implement version control and automated deployment processes.
  • Collaborate with data architects, analysts, application teams, and business stakeholders to translate requirements into technical solutions.
  • Document pipeline architecture, transformation logic, dependencies, and operational procedures.
  • Ensure solutions meet security, governance, monitoring, and data-protection standards.

Requirements

  • 4–6 years of relevant experience in data engineering and cloud-based data platforms.
  • Hands-on expertise with Azure Databricks, PySpark, Apache Spark, Python, and advanced SQL.
  • Experience developing scalable ETL/ELT pipelines for batch and large-scale data processing.
  • Strong knowledge of Delta Lake, including Delta tables, ACID transactions, schema evolution, merge/upsert operations, and table optimization.
  • Experience with Azure Data Lake Storage and Azure Data Factory.
  • Knowledge of Spark and Databricks performance optimization, including partitioning, caching, join strategies, shuffle optimization, file sizing, and cluster configuration.
  • Experience with Git-based version control and automated deployment across environments.
  • Understanding of data quality, security, monitoring, troubleshooting, and production support.

Benefits

  • Full-time position located at IND Bangalore - MTP C4, 3rd Flr.

Tech Stack

Categories

Data Engineering
Concentrix

About Concentrix

10,000+ employees

We’re Concentrix, a Fortune 500® technology and services leader, helping the world's best brands cut through AI hype and create intelligent operations that perform in the real world. We design, build, and run integrated human and AI solutions, harnessing the insight from billions of real-world interactions to help 2000+ of the world’s most complex organizations solve their toughest business challenges. Backed by 20+ years of operational experience and battle tested AI, we’re the Intelligent Transformation Partner that helps clients across every major vertical move from AI ambition to measurable, scalable performance.

Contact me