about 3 hours ago
Bengaluru, IndiaMid Level / Senior
H1B Sponsor
Responsibilities
- Design, develop, and maintain data pipelines and models across various data layers.
- Write clean and efficient transformation logic using dbt and Databricks Delta Live Tables.
- Participate in data architecture discussions and contribute to pipeline design decisions.
- Build and enforce data quality checks at every layer of the pipeline.
- Monitor data quality alerts and perform root cause analysis for anomalies.
- Develop and maintain data quality SLAs and resolve source-level issues.
- Collaborate with cross-functional teams to gather requirements for data products.
- Troubleshoot production pipeline failures and support root cause analysis.
- Build and maintain analytical dashboards using Tableau or Databricks AI/BI.
- Design and optimize Databricks Genie spaces for natural language querying.
- Develop and optimize AI agents to accelerate pipeline development.
Requirements
- 4 to 6 years of experience in data engineering or a related field.
- Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
- Hands-on experience with data pipelines on Databricks or similar platforms.
- Proficiency in Python and SQL, with experience in dbt and Databricks Delta Live Tables.
- Experience designing and implementing data quality frameworks.
- Ability to build end-to-end reconcilable pipelines.
- Familiarity with relational and NoSQL databases, REST APIs, and cloud services.
- Strong understanding of lakehouse architecture and CI/CD pipelines.
- Experience with Databricks Genie spaces and AI/BI dashboards.
- Ability to engage with stakeholders and translate business requirements into data products.
- Strong communication and collaboration skills.
Benefits
- Opportunity to work with some of the smartest minds to solve complex challenges.
- Impactful role in shaping a global, cloud-native, and AI-driven platform.
- Innovative, collaborative, and fast-paced culture.