Kyndryl

Data Engineer – Databricks & dbt

Kyndryl
Apply
23 hours ago
Chennai, India or Bengaluru, IndiaSenior

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Databricks and dbt for enterprise data ingestion, transformation, and processing.
  • Build and optimize ELT frameworks supporting analytics, reporting, machine learning, and AI use cases.
  • Develop and manage dbt models, macros, tests, documentation, source management, and deployment processes.
  • Design and implement Databricks Lakehouse architectures using Delta Lake and cloud-native data services.
  • Create semantic data layers and business-ready datasets for self-service analytics and decision-making.
  • Implement data quality frameworks, automated testing, monitoring, governance, lineage, and security controls.
  • Optimize query execution, storage efficiency, platform performance, and processing costs.
  • Build, deploy, and maintain CI/CD pipelines for data engineering development, testing, and releases.
  • Support production environments through monitoring, troubleshooting, incident resolution, and continuous improvement.
  • Collaborate with data architects, analysts, cloud engineers, AI specialists, business stakeholders, and engineering teams.

Requirements

  • 5+ years of hands-on experience in data engineering, designing, developing, and supporting production-grade data platforms and solutions.
  • Expert-level experience with dbt Core, including project structure, models, macros, tests, documentation, source management, CI/CD integration, and troubleshooting.
  • Strong hands-on experience with Databricks Lakehouse, including Databricks SQL, Unity Catalog, Delta Lake, Workflows, and performance optimization.
  • Advanced SQL proficiency covering complex transformations, query optimization, dimensional modeling, partitioning, and large-scale data processing.
  • Experience designing data warehouses with SCD Type 1 and Type 2 models, fact and dimension tables, and enterprise reporting layers.
  • Proficiency in Python for data ingestion, automation, orchestration, and pipeline development.
  • Experience with ingestion frameworks using REST APIs, SFTP, SQL databases, cloud storage, and varied file formats.
  • Experience implementing data quality, testing, governance, lineage, and security controls with Unity Catalog and dbt testing.
  • Understanding of Azure Storage Accounts, Azure SQL Database, Azure Functions, Azure Data Factory, and cloud fundamentals.
  • Experience building and supporting CI/CD pipelines with GitHub Actions.
  • Preferred qualifications include Azure and Google Cloud Platform experience, dlt or similar ingestion frameworks, data governance and metadata management, Terraform, Power BI, and advanced Python concepts such as object-oriented programming, decorators, and multithreading.
  • Ability to collaborate with DevOps, data engineering, analytics, and business teams in global delivery environments.

Benefits

  • Hybrid-friendly work culture with support for financial, mental, physical, and social well-being.
  • Professional development through certifications with Microsoft, Google, and Amazon, coaching, learning opportunities, and hands-on experiences.
  • Personalized career development goals, continuous feedback, mentorship, and opportunities to progress toward senior data engineering, architecture, platform, analytics engineering, or engineering leadership roles.
  • Inclusive culture focused on belonging, empathy, continuous learning, and shared success.

Tech Stack

Categories

Data Engineering
Kyndryl

About Kyndryl

10,000+ employees

Kyndryl is a public IT services company that designs, runs, and modernizes mission-critical infrastructure for large enterprises and governments. Spun off from IBM in 2021, it is headquartered in New York City and trades on the NYSE (ticker: KD). The company provides managed infrastructure, cloud migration and operations across AWS, Azure, and Google Cloud, plus mainframe, network, security, data, and digital workplace services.

Contact me