23 hours ago
Chennai, India or Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and dbt for enterprise data ingestion, transformation, and processing.
- Build and optimize ELT frameworks supporting analytics, reporting, machine learning, and AI use cases.
- Develop and manage dbt models, macros, tests, documentation, source management, and deployment processes.
- Design and implement Databricks Lakehouse architectures using Delta Lake and cloud-native data services.
- Create semantic data layers and business-ready datasets for self-service analytics and decision-making.
- Implement data quality frameworks, automated testing, monitoring, governance, lineage, and security controls.
- Optimize query execution, storage efficiency, platform performance, and processing costs.
- Build, deploy, and maintain CI/CD pipelines for data engineering development, testing, and releases.
- Support production environments through monitoring, troubleshooting, incident resolution, and continuous improvement.
- Collaborate with data architects, analysts, cloud engineers, AI specialists, business stakeholders, and engineering teams.
Requirements
- 5+ years of hands-on experience in data engineering, designing, developing, and supporting production-grade data platforms and solutions.
- Expert-level experience with dbt Core, including project structure, models, macros, tests, documentation, source management, CI/CD integration, and troubleshooting.
- Strong hands-on experience with Databricks Lakehouse, including Databricks SQL, Unity Catalog, Delta Lake, Workflows, and performance optimization.
- Advanced SQL proficiency covering complex transformations, query optimization, dimensional modeling, partitioning, and large-scale data processing.
- Experience designing data warehouses with SCD Type 1 and Type 2 models, fact and dimension tables, and enterprise reporting layers.
- Proficiency in Python for data ingestion, automation, orchestration, and pipeline development.
- Experience with ingestion frameworks using REST APIs, SFTP, SQL databases, cloud storage, and varied file formats.
- Experience implementing data quality, testing, governance, lineage, and security controls with Unity Catalog and dbt testing.
- Understanding of Azure Storage Accounts, Azure SQL Database, Azure Functions, Azure Data Factory, and cloud fundamentals.
- Experience building and supporting CI/CD pipelines with GitHub Actions.
- Preferred qualifications include Azure and Google Cloud Platform experience, dlt or similar ingestion frameworks, data governance and metadata management, Terraform, Power BI, and advanced Python concepts such as object-oriented programming, decorators, and multithreading.
- Ability to collaborate with DevOps, data engineering, analytics, and business teams in global delivery environments.
Benefits
- Hybrid-friendly work culture with support for financial, mental, physical, and social well-being.
- Professional development through certifications with Microsoft, Google, and Amazon, coaching, learning opportunities, and hands-on experiences.
- Personalized career development goals, continuous feedback, mentorship, and opportunities to progress toward senior data engineering, architecture, platform, analytics engineering, or engineering leadership roles.
- Inclusive culture focused on belonging, empathy, continuous learning, and shared success.
Tech Stack
Categories
Data Engineering
About Kyndryl
Kyndryl is a public IT services company that designs, runs, and modernizes mission-critical infrastructure for large enterprises and governments. Spun off from IBM in 2021, it is headquartered in New York City and trades on the NYSE (ticker: KD). The company provides managed infrastructure, cloud migration and operations across AWS, Azure, and Google Cloud, plus mainframe, network, security, data, and digital workplace services.
