Senior Data Engineer
CMG Financial1 month ago
USA (city not specified)Senior
Base Salary
$130k - $165k/yr
Responsibilities
- Build and operate ingestion pipelines from on-premises SQL Server, SaaS, and vendor sources into Snowflake using Fivetran, CDC or Change Tracking, Azure Data Factory, and vendor data shares.
- Develop and maintain Dagster assets, schedules, sensors, and checks in Python, and migrate GitHub Actions and legacy SSIS jobs to the orchestration platform.
- Write and review dbt models, tests, seeds, snapshots, and data contracts for Raw, Bronze, and downstream Silver layers.
- Manage Snowflake databases, roles, grants, warehouses, service users, and policies as code with Pulumi and manage Azure resources with Terraform.
- Implement role-based access, tag-based classification, dynamic masking, least-privilege service accounts, key-pair authentication, and auditable just-in-time elevation.
- Build freshness, volume, and schema checks, alerting, runbooks, and remediation for pipeline, grant, and data-tagging failures.
- Contribute to specifications, architecture decision records, pull requests, code reviews, production promotion gates, and migration reconciliation.
- Partner with Servicing, Lending, Marketing, Domo, BI, security, compliance, application, and DBA teams, and mentor engineers.
- Work overtime when needed to meet project deadlines.
Requirements
- 7+ years of data engineering experience, including 3+ years building production pipelines on a cloud data warehouse; Snowflake experience is preferred.
- Expert SQL and strong Python skills for tested pipeline and platform code.
- Production experience with dbt modeling, testing, CI, and environments.
- Experience with a modern orchestrator such as Dagster, Airflow, or Prefect, and managed ingestion or CDC such as Fivetran.
- Infrastructure-as-code experience with Pulumi, Terraform, or similar, plus CI/CD experience with GitHub Actions or Azure DevOps.
- Deep Snowflake security experience including RBAC, masking and row-access policies, tags, service authentication, and cost-aware warehouse management.
- Working knowledge of SQL Server, CDC, Change Tracking, and execution plans sufficient to collaborate with DBAs.
- Experience handling regulated or sensitive PII and financial data with auditable controls.
- Clear written communication for specifications, pull request descriptions, and incident notes.
- Preferred experience includes mortgage, lending, or loan-servicing domains; Azure Data Factory, ADLS, Key Vault, Entra ID, and SCIM; Snowflake Iceberg, catalog-linked tables, secure sharing, and reader accounts; OpenMetadata or DataHub; SSIS migration; Domo or other BI platforms; AI coding assistants; Kafka or Azure Event Hubs; Snowpipe Streaming; Temporal; Kubernetes; established data modeling approaches; and AI-Driven Development Lifecycle workflows.
Benefits
- Eligible employees receive a comprehensive benefits package.
- The role operates in an ADA-compliant office environment with computer-based work and movement throughout the day.
- Flexibility to work overtime to meet project deadlines is required.
Tech Stack
Apache AirflowApache KafkaAzuredbtGitHub ActionsKubernetesMicrosoft SQL ServerPythonSnowflakeSQLTerraformTypeScript
Categories
Data Engineering