Senior Data Engineer - IGEN
U.S. Venture, Inc.2 months ago
Appleton, WI, USAMid Level / Senior
Responsibilities
- Lead the design and implementation of enterprise-grade data pipelines on Snowflake and Azure across ingestion, transformation, and serving layers.
- Architect CDC, batch, and streaming ingestion and integration patterns across operational databases, SaaS platforms, regulatory sources, and product telemetry.
- Establish dbt-based transformation frameworks, modeling conventions, testing, documentation, version control, and CI/CD practices.
- Own data pipeline SLAs, including freshness, completeness, error-rate targets, runbooks, observability, and production on-call operations.
- Drive schema governance, conceptual/logical/physical data modeling, lineage, cataloging, metadata management, and breaking-change management.
- Design and operate the regulatory intelligence pipeline for downstream AI-assisted change-impact analysis.
- Implement data security, privacy, compliance, access control, encryption, PII handling, and audit-trail controls aligned with SOC 2 Type 2 and AI governance requirements.
- Partner with the Director of Data & Analytics on the data Center of Excellence operating model, prioritization, stakeholder reviews, and technical roadmap.
- Use and evaluate AI development assistants including GitHub Copilot, Microsoft Copilot, Claude, and emerging agent-based tooling.
- Optimize Snowflake warehouse sizing, query performance, storage, and cost visibility.
- Mentor Data Engineers through code reviews, architectural pairing, and knowledge sharing.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, or a related discipline, or equivalent demonstrated experience.
- 4–7 years of professional data engineering experience with technical leadership on enterprise-grade data platforms.
- Advanced SQL proficiency, including complex query authoring, performance tuning, and schema design at scale.
- Hands-on experience with dbt, Dataform, or an equivalent transformation framework, including modular models, testing, documentation, and CI/CD integration.
- Hands-on experience with Airflow, Azure Data Factory, Dagster, or an equivalent workflow orchestration tool.
- Production experience with Snowflake, including warehouse design, role-based access control, performance optimization, and cost management.
- Strong working experience with Azure data services including Azure Data Factory, Azure SQL, Storage, Key Vault, and Azure security and identity services.
- Experience designing and operating production data pipelines with ingestion patterns, transformation frameworks, and observability.
- Experience using AI development assistants as part of daily development practice.
- Knowledge of conceptual, logical, and physical data modeling, including dimensional modeling and modern data product patterns.
- Knowledge of data governance, lineage, cataloging, classification, metadata management, CI/CD, and rollback strategies.
- Understanding of SOC 2, GDPR, PII handling, and regulated-data security and compliance requirements.
- Proficiency in Python, Scala, or an equivalent programming language for data work.
- Strong communication, collaboration, mentoring, and engineering talent-development abilities.
- Preferred qualifications include SnowPro Core or Advanced certification, Azure data certification such as DP-203, Power BI experience, AI/ML service integrations, streaming and CDC experience, data Center of Excellence experience, Terraform or Bicep experience, regulated-industry experience, data mesh or lakehouse familiarity, and data observability tooling experience.
Benefits
- Onsite, hybrid, or remote work options are available; the onsite location is Appleton, Wisconsin.
- The position offers the opportunity to lead a core enterprise data platform, work with Azure and Snowflake technologies, support AI-powered capabilities, and mentor a growing data engineering function.
Tech Stack
Categories
Data Engineering
About U.S. Venture, Inc.
U.S. Venture, Inc. is a privately held energy and automotive distributor and logistics technology provider. It wholesales fuels, renewable energy, lubricants, tires, and parts, and offers software-enabled freight and energy management through brands such as Breakthrough, U.S. AutoForce, U.S. Lubricants, U.S. Energy, and IGEN. Founded in 1951 and headquartered in Appleton, Wisconsin, it serves fleets, shippers, and retailers across North America.