Senior Data Engineer

16 days ago

Bengaluru, IndiaSenior

Responsibilities

Collaborate with engineers, product managers, and data scientists to develop end-to-end pipelines, data solutions, and foundational datasets.
Design and own data architecture for large-scale projects while making informed design and operational trade-offs.
Build, launch, and optimize data pipelines, data models, and visualizations across multiple products and domains.
Define and manage service-level agreements for owned datasets.
Implement data security models, privacy safeguards, data quality improvements, and data governance processes.
Solve data integration challenges using ETL/ELT patterns, frameworks, and query techniques for structured and unstructured sources.
Optimize production code, pipelines, dashboards, frameworks, and systems for performance and development efficiency.
Mentor team members and exchange actionable feedback.
Maintain flexibility for evening-hour availability.

Bachelor's degree in computer science, computer engineering, or a relevant technical field; a master's degree is preferred.
5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools involving large cloud-based datasets.
Extensive experience with SQL, Snowflake, dbt, ETL/ELT, and data modeling.
5+ years of Python experience and experience building scalable big data solutions and ETL ecosystems.
Hands-on experience with MySQL, Microsoft SQL Server, and PostgreSQL.
Familiarity with Airflow, Automic, and CI/CD pipelines.
Experience delivering high code quality, system reliability, and performance.
Experience with Spark and PySpark for large-scale data processing.
Strong proficiency with Terraform.

Apache AirflowApache Spark AWSDatadogdbtGit JavaMicrosoft SQL ServerMySQLPostgreSQL Python ReactScalaSnowflakeSQL Terraform TypeScript