Lead Data Engineer - Snowflake + DBT (Data build Tools)
Silicon Valley Bank14 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Design, build, and maintain enterprise data platforms supporting data warehouses, operational data stores, data marts, data lakes, and business-critical data integrations.
- Establish enterprise-scale ETL/ELT procedures, data pipelines, ingestion frameworks, and scheduled or trigger-based ingestion patterns.
- Design performance-optimized database objects and tune complex data pipelines and SQL queries across row-based and columnar databases.
- Implement appropriate data access, security, privacy, governance, resilience, scalability, and future-proofing for data solutions.
- Perform architectural impact analysis, identify technical risks and issues, and recommend alternative solutions and process improvements.
- Manage developer deliverables, conduct design reviews, coordinate release activities, and estimate project timelines.
- Drive automation and optimize data flows, processes, and data products using agile engineering practices.
- Collaborate with Product Owners and global technology teams on planning, requirements clarification, delivery coordination, and business objectives.
- Provide technical support for production incidents and failures, including root cause analysis and resolution.
- Lead a team of Data Engineering associates and partner with senior leaders and cross-functional stakeholders.
Requirements
- 10+ years of experience designing and building data warehouses and data lakes.
- Strong knowledge of data warehouse principles, data architecture, data design patterns, and relational, dimensional, or Data Vault modeling.
- Expertise with large-scale data warehousing applications and databases, including Oracle, Netezza, Teradata, and SQL Server.
- Experience with cloud-based data platforms, especially Snowflake and AWS.
- Expertise designing and developing complex data pipelines using enterprise ETL tools such as IBM DataStage, SSIS, or SAP BusinessObjects Data Services.
- Experience with Unix and Python or an equivalent scripting language.
- Knowledge of transformation and ELT tools such as dbt, Qlik Replicate, AWS Glue, or Snowpark.
- Expertise in SQL and stored procedures, including tracing and resolving data integrity issues.
- Experience with logical and physical data models and high-volume ETL/ELT processes.
- Experience with scheduling tools such as Control-M, performance tuning of data pipelines and database objects, and GitLab version control.
- Strong problem-solving, incident-management, root-cause-analysis, communication, collaboration, and stakeholder-partnership skills.
- Financial industry experience is a plus.
Benefits
- Hybrid role based in Bangalore.
- Collaboration with global technology teams, primarily across US time zones.
- Inclusive and accessible hiring process with accommodations available during application, interviews, and onboarding.
Tech Stack
Categories
Data Engineering
About Silicon Valley Bank
Silicon Valley Bank provides commercial banking, treasury management, venture debt, and global services to startups, growth-stage companies, and investors in technology, life sciences, healthcare, and premium wine industries. Founded in 1983 and based in Santa Clara, California, it operates in the U.S. as Silicon Valley Bank, a division of First Citizens Bank, following its 2023 acquisition. Clients include venture-backed companies and venture capital/private equity firms needing specialized credit, cash management, and international banking.