Senior Data Engineer

3 months ago

Pune, IndiaSenior

Responsibilities

Design and deliver complex, scalable data pipelines and infrastructure components end-to-end through production.
Design and implement data models across relational, NoSQL, and lakehouse architectures for analytics and machine learning workloads.
Architect and optimize data flows across Azure, AWS, or GCP for performance, cost-efficiency, and reliability.
Build and maintain orchestration workflows using tools such as Apache Airflow, dbt, or Azure Data Factory.
Define and implement data quality frameworks with validation, automated testing, monitoring, and alerting.
Collaborate with Data Scientists and Analytics Engineers to meet downstream data consumption requirements.
Contribute to architectural reviews and platform decisions with technical trade-off analysis.
Lead code reviews and enforce engineering, documentation, security, and governance standards.
Mentor Associate and mid-level Data Engineers and support their professional development.
Identify platform improvements, technical debt, and opportunities to modernize the data stack.

Bachelor's or master's degree in Computer Science, Computer Engineering, Information Technology, or a related field.
6–8 years of progressive hands-on experience in data engineering delivering production-grade data infrastructure.
Proven professional experience working with large-scale cloud data platforms.
Expert-level SQL and strong Python skills.
Working knowledge of Spark, Scala, or Java is a plus.
Deep hands-on experience with Azure, AWS, or GCP data services, including services such as Azure Data Factory, Synapse, S3, Redshift, and BigQuery.
Advanced knowledge of data orchestration tools such as Apache Airflow, dbt, and Prefect, plus CI/CD practices for data pipelines.
Strong understanding of dimensional modeling, vault data modeling, and lakehouse architecture patterns.
Experience with streaming and batch processing frameworks such as Apache Kafka, Spark Streaming, and Azure Event Hubs.
Strong grasp of data governance, data quality frameworks, and metadata management.
Strong experience with Snowflake, Redshift, or Azure Synapse, including performance tuning and access control.
Ability to communicate complex technical designs clearly and mentor less experienced engineers effectively.
ITIL certification is advantageous but not mandatory.
Fluent English language skills.