23 hours ago
Chennai, India or Bengaluru, IndiaSenior
Responsibilities
- Develop, test, and deploy scalable data transformation pipelines using dbt and SQL on Databricks.
- Design and maintain dimensional models including SCD1 and SCD2, with advanced partitioning and query optimization.
- Implement data governance, data quality checks, security controls, and data discovery using Databricks Unity Catalog and dbt testing.
- Build ingestion pipelines from APIs, SFTP, SQL databases, and cloud storage using Python and preferably dlt.
- Design governed, reliable, low-latency data products supporting Agentic AI and Generative AI applications.
- Configure and maintain data CI/CD workflows using GitHub Actions in partnership with DevOps teams.
- Document solutions, contribute to runbooks and knowledge bases, collaborate with global teams, and mentor junior and mid-level engineers.
Requirements
- At least 5 years of dedicated, hands-on data engineering experience delivering production-grade solutions.
- Expert-level dbt Core experience, including project structuring, macros, testing, CI/CD integration, and production troubleshooting.
- Strong Databricks Lakehouse experience, especially Databricks SQL, Unity Catalog, Databricks Workflows, Delta Lake, and performance optimization.
- Understanding of Generative AI, LLMs, RAG, embeddings, vector databases, and semantic layers.
- Proficiency in Python for data ingestion and automation, with experience using data-loading libraries preferred.
- Advanced SQL, query optimization, MPP engine concepts, data warehousing, and dimensional modeling experience.
- Experience with diverse ingestion patterns, big-data file formats, and APIs, SFTP, and SQL sources.
- Understanding of cloud object storage, secret management, virtual machines, functions, and containers, including services such as ADLS/GCS and Key Vault/Secret Manager.
- Experience configuring and troubleshooting data-specific CI/CD workflows, preferably with GitHub Actions.
- Strong communication and collaboration skills for working with distributed global teams.
Benefits
- Hybrid-friendly work culture with programs supporting financial, mental, physical, and social well-being.
- Career development support including personalized development goals, continuous feedback, coaching, and hands-on learning.
- Access to certification opportunities with Microsoft, Google, and Amazon.
- Chennai-based role with collaboration across global teams.
About Kyndryl
Kyndryl is a public IT services company that designs, runs, and modernizes mission-critical infrastructure for large enterprises and governments. Spun off from IBM in 2021, it is headquartered in New York City and trades on the NYSE (ticker: KD). The company provides managed infrastructure, cloud migration and operations across AWS, Azure, and Google Cloud, plus mainframe, network, security, data, and digital workplace services.
