Quantiphi

Senior Data Engineer - Snowflake

Quantiphi
Apply
2 days ago
Mumbai, India or Bengaluru, IndiaSenior

Responsibilities

  • Design, develop, and optimize scalable cloud-native data platforms and high-performance batch and analytical data pipelines on Snowflake.
  • Own the full data engineering lifecycle, including ingestion, transformation, modeling, validation, production support, monitoring, troubleshooting, and optimization.
  • Migrate legacy SQL, stored procedures, ETL scripts, and database objects to Snowflake-compatible SQL using Snowflake SnowConvert AI.
  • Build data processing, transformation, and automation solutions with SQL, Spark/PySpark, and Python.
  • Implement Snowflake Procedures, UDFs, Streams, Tasks, Dynamic Tables, Snowpipe, Snowpark, and Snowflake Cortex capabilities.
  • Optimize Snowflake performance through clustering keys, materialized views, query profiling, resource monitors, and warehouse sizing.
  • Implement Snowflake security and governance features including RBAC, data masking, row access policies, and tagging.
  • Support data sharing, collaboration, cross-region replication, and integrations with cloud data platforms.
  • Perform data validation, reconciliation, and defect triage across source and target systems during migrations.
  • Collaborate with cross-functional teams and stakeholders to deliver reliable data solutions with measurable business impact.

Requirements

  • At least 4 years of hands-on data engineering experience building and maintaining large-scale data platforms and pipelines on Snowflake.
  • Strong SQL expertise, including complex analytical queries, window functions, stored procedures, and schema design.
  • Proficiency with Spark or PySpark and Python for data processing, transformation, and automation.
  • Knowledge of data modeling, schema design, partitioning strategies, Parquet, ORC, Avro, data warehousing, dimensional modeling, and slowly changing dimensions.
  • Experience with batch and streaming pipelines, ETL/ELT frameworks, orchestration tools, monitoring, logging, alerting, and observability frameworks.
  • Experience with Snowflake SnowConvert AI and Snowflake core capabilities, including Procedures, UDFs, Streams, Tasks, Dynamic Tables, Snowpipe, Snowpark, and Snowflake Cortex.
  • Knowledge of Snowflake performance optimization, security, governance, data sharing, Snowflake Marketplace, and cross-region replication.
  • Experience with Git version control, branching strategies, code reviews, release management, troubleshooting, debugging, and production support.
  • Strong experience using AI and LLM tools for data engineering, such as Snowflake CoCo, Kiro, GitHub Copilot, or Cursor.
  • Snowflake SnowPro Core Certification is required; advanced certifications are a plus.
  • Experience with dbt, legacy SQL platforms such as Hive or Impala, Snowpark, or Snowflake migration tooling is preferred.
  • Experience with AWS services including S3, Glue, Redshift, EMR, and Lambda and their integration with Snowflake is preferred.
  • Experience with Jenkins, GitHub Actions, GitLab CI, Terraform, hybrid or multi-cloud data pipelines, Kafka, Iceberg, Delta Lake, data governance, data cataloging, and metadata management is preferred.
  • Strong communication, problem-solving, stakeholder management, environment troubleshooting, and dependency troubleshooting skills.

Tech Stack

Amazon RedshiftApache HiveApache KafkaApache SparkAWSdbtGitGitHub ActionsGitLab CI/CDJavaJenkinsPythonScalaSnowflakeSQLTerraform

Categories

Data Engineering
Quantiphi

About Quantiphi

1,001-5,000 employees

Quantiphi is an AI-first digital engineering and consulting firm that designs and implements machine learning, data, and cloud solutions for large enterprises across industries. Its teams build production systems—such as generative AI applications, computer vision, and predictive analytics—primarily on Google Cloud and other hyperscalers, delivered as professional services and managed solutions. Founded in 2013 and headquartered in Marlborough, Massachusetts, the company is privately held and a Google Cloud partner.

Contact me