2 months ago
USA (city not specified)Mid Level
H1B sponsor
Base Salary
$150k - $180k/yr
Responsibilities
- Build, maintain, and improve batch and incremental ingestion pipelines with pagination, rate-limit handling, retries, schema changes, deletes, replay, and backfill support.
- Develop SQL and Python solutions to collect, validate, transform, and publish data for downstream consumers.
- Use Snowflake and dbt to build reliable transformations, incremental models, reusable datasets, metadata, schemas, data quality checks, lineage, and freshness monitoring.
- Evaluate and implement connectors, source-provided shares, file delivery, and custom extraction approaches based on coverage, recovery, security, supportability, and cost.
- Build automated unit, integration, and data-quality tests and investigate discrepancies before publishing data.
- Implement least-privilege access controls, service identities, classification, masking, and row- or column-level controls with Security, IAM, and data owners.
- Build version-controlled deployment processes for code, database changes, and access grants across development, quality assurance, and production environments.
- Monitor pipeline health, freshness, performance, and failures; recover failed loads; maintain documentation and runbooks; and communicate incidents and downstream impacts.
- Optimize Snowflake workloads, queries, transformations, and storage for performance, reliability, and cost efficiency.
- Collaborate with Analytics and source-system owners to align shared datasets with semantic models and governed access requirements.
- Participate in backlog refinement, estimation, code review, iterative delivery, and proactive improvements to data architecture and engineering practices.
Requirements
- Bachelor’s degree in computer science, information systems, engineering, mathematics, or a related field, or equivalent experience.
- At least 3 years of experience in data engineering, software engineering, analytics engineering, or a related technical role.
- Professional experience writing production-quality SQL and Python.
- Experience independently building, deploying, and supporting production data pipelines, including orchestration, scheduling, dependency management, monitoring, and failed-run recovery.
- Hands-on experience with a cloud data warehouse and transformation framework; Snowflake and dbt experience is strongly preferred.
- Understanding of relational and dimensional data modeling, keys, grain, ELT/ETL patterns, APIs, source-system integration, schema evolution, and historical-change handling.
- Experience with source control, code review, automated testing, and CI/CD software engineering practices.
- Experience using AI-assisted development tools with critical review of generated code and tests.
- Understanding of data quality, metadata, lineage, role-based access, privacy, secrets, service credentials, and secure enterprise-data handling.
- Ability to investigate data issues, communicate findings clearly, and collaborate with engineers, analysts, source-system owners, security teams, and business stakeholders.
- Preferred experience includes Azure cloud storage, containerized or serverless workloads, Terraform, Salesforce, NetSuite, REST or GraphQL APIs, pipeline migration, observability, data catalogs, lineage tooling, data quality platforms, BI datasets, governed API access, entity matching, and historical change tracking.
About AHEAD
AHEAD is an IT services and consulting firm that designs, builds, and operates digital platforms for large enterprises across cloud infrastructure, automation, data and analytics, security, and DevOps. It generates revenue through consulting, systems integration, and managed services, including cloud management and operations. Founded in 2007 and headquartered in Chicago, it is privately held and owned by Centerbridge Partners.