Senior Data Engineer
WatchGuard Technologies, Inc.5 months ago
Base Salary
$140k - $150k/yr
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines with Azure Data Factory and Apache Airflow across Bronze, Silver, and Gold Medallion layers.
- Implement incremental loads, change data capture, and event-driven ingestion patterns.
- Build and optimize Snowflake tables, views, dynamic tables, streams, tasks, and stored procedures.
- Develop modular, tested, documented dbt models with consistent naming, lineage, incremental strategies, snapshots, and semantic-layer alignment.
- Implement data validation, anomaly detection, freshness checks, schema-drift alerts, and data contracts using Elementary and related quality controls.
- Build data quality dashboards and manage validation for row counts, null rates, referential integrity, value domains, schema evolution, and SCD Type 2 dimensions.
- Manage Azure Data Lake Storage Gen2 structures, lifecycle policies, access tiers, and partitioning strategies.
- Build and maintain Azure Functions and Azure Logic Apps for event-driven processing and operational automation.
- Manage secrets and environment configuration with Azure Key Vault and contribute to Terraform or Bicep infrastructure provisioning.
- Translate business requirements into data models and pipeline designs, participate in code reviews, enforce standards, and mentor junior engineers.
- Support CI/CD deployment of pipelines and dbt models across Dev, Test, and Prod environments.
Requirements
- At least 4 years of professional data engineering experience, including at least 2 years working on Azure cloud data platforms.
- Advanced SQL skills, including window functions, common table expressions, recursive queries, query profiling, and Snowflake warehouse tuning.
- Experience with Snowflake streams, tasks, Snowpipe, dynamic tables, row-level security, and credit cost optimization.
- Production experience writing, testing, and documenting dbt models and integrating Elementary for observability and anomaly detection.
- Hands-on experience with Azure Data Factory, ADLS Gen2, Azure Key Vault, Azure Functions, and Azure Logic Apps.
- Experience authoring and monitoring Airflow DAGs, task dependencies, XCom, sensors, connections, and cloud-hosted deployments.
- Python experience for data pipeline scripting, PySpark basics, REST API integration, and unit testing.
- Hands-on implementation of Bronze, Silver, and Gold Medallion architecture, including layer-specific validation and SCD Type 2 management.
- Preferred experience with Snowflake Cortex, dbt Semantic Layer, Boomi Data Hub, LLM-based quality checks, AI-assisted anomaly detection, Microsoft Fabric, OneLake, data mesh, data products, Terraform, or Bicep.
Benefits
- Base salary range of $140,000-$150,000 per year for full-time employment, exclusive of benefits.
- Medical, dental, vision, disability, and life insurance.
- Healthcare HSA and employer HSA contribution.
- 10 paid holidays, 10 days of paid annual leave, and 9 days of paid sick time.
- Paid parental leave, education assistance, dependent care HSA match, adoption assistance, fertility care support, and backup care for family and pets.
- Employee resource groups, employee referral program, and Employee Assistance Program.
- Remote and office-based work options are available, with team members working remotely and in offices worldwide.
About WatchGuard Technologies, Inc.
WatchGuard Technologies builds network and endpoint security products for businesses, delivered through a unified platform for managed service providers and resellers. Its portfolio includes next-generation firewalls/UTM appliances, secure Wi‑Fi, multi‑factor authentication, identity and endpoint protection, with subscription services and hardware/software licenses sold via channel partners. Founded in 1996 and headquartered in Seattle, it is privately held by Vector Capital and reports protecting more than 250,000 customer organizations worldwide.