Kyndryl

Senior Data Engineer

Kyndryl
Apply
23 hours ago
Chennai, India or Bengaluru, IndiaSenior

Responsibilities

  • Develop, test, and deploy scalable data transformation pipelines using dbt and SQL on Databricks.
  • Design and maintain dimensional models including SCD1 and SCD2, with advanced partitioning and query optimization.
  • Implement data governance, data quality checks, security controls, and data discovery using Databricks Unity Catalog and dbt testing.
  • Build ingestion pipelines from APIs, SFTP, SQL databases, and cloud storage using Python and preferably dlt.
  • Design governed, reliable, low-latency data products supporting Agentic AI and Generative AI applications.
  • Configure and maintain data CI/CD workflows using GitHub Actions in partnership with DevOps teams.
  • Document solutions, contribute to runbooks and knowledge bases, collaborate with global teams, and mentor junior and mid-level engineers.

Requirements

  • At least 5 years of dedicated, hands-on data engineering experience delivering production-grade solutions.
  • Expert-level dbt Core experience, including project structuring, macros, testing, CI/CD integration, and production troubleshooting.
  • Strong Databricks Lakehouse experience, especially Databricks SQL, Unity Catalog, Databricks Workflows, Delta Lake, and performance optimization.
  • Understanding of Generative AI, LLMs, RAG, embeddings, vector databases, and semantic layers.
  • Proficiency in Python for data ingestion and automation, with experience using data-loading libraries preferred.
  • Advanced SQL, query optimization, MPP engine concepts, data warehousing, and dimensional modeling experience.
  • Experience with diverse ingestion patterns, big-data file formats, and APIs, SFTP, and SQL sources.
  • Understanding of cloud object storage, secret management, virtual machines, functions, and containers, including services such as ADLS/GCS and Key Vault/Secret Manager.
  • Experience configuring and troubleshooting data-specific CI/CD workflows, preferably with GitHub Actions.
  • Strong communication and collaboration skills for working with distributed global teams.

Benefits

  • Hybrid-friendly work culture with programs supporting financial, mental, physical, and social well-being.
  • Career development support including personalized development goals, continuous feedback, coaching, and hands-on learning.
  • Access to certification opportunities with Microsoft, Google, and Amazon.
  • Chennai-based role with collaboration across global teams.

Tech Stack

DatabricksdbtGitHub ActionsPythonSQL

Categories

Data Engineering
Kyndryl

About Kyndryl

10,000+ employees

Kyndryl is a public IT services company that designs, runs, and modernizes mission-critical infrastructure for large enterprises and governments. Spun off from IBM in 2021, it is headquartered in New York City and trades on the NYSE (ticker: KD). The company provides managed infrastructure, cloud migration and operations across AWS, Azure, and Google Cloud, plus mainframe, network, security, data, and digital workplace services.

Contact me