10 days ago
Gurgaon, IndiaSenior
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and AWS or Azure.
- Implement data transformation logic, validation rules, and data quality checks.
- Develop and manage data models, schemas, and data warehouse structures for analytics and reporting.
- Monitor, troubleshoot, and optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Ensure data governance, security, and compliance across data processing and storage layers.
- Collaborate with cross-functional teams and manage client, stakeholder, and team relationships.
Requirements
- 5–7 years of experience in a Data Engineering role.
- B.Tech, BE, or equivalent technical background.
- Strong Python and SQL programming skills with experience building and optimizing data pipelines.
- Hands-on experience with ETL/ELT pipelines and AWS or Azure cloud data services.
- Experience with Databricks or similar distributed data processing frameworks such as AWS Glue.
- Familiarity with Airflow and Git.
- Experience handling large datasets, data quality checks, and data ingestion, storage, and consumption architectures.
- Understanding of data quality, monitoring, and basic DevOps/DataOps practices.
- Strong problem-solving, communication, collaboration, client management, stakeholder management, and team management skills.
