29 days ago
Base Salary
$205k - $230k/yr
Responsibilities
- Build batch and streaming pipelines connecting operational databases, product events, billing systems, and external sources.
- Implement recoverable ingestion using change-data capture, schema-change handling, idempotent processing, and safe backfills.
- Operate and improve Snowflake, including access controls, workload management, query performance, and compute and storage costs.
- Improve workflow orchestration and deployment processes for safely testing, shipping, and debugging pipelines.
- Build checks for stale, missing, duplicated, or inconsistent records before downstream consumption.
- Collaborate with analytics partners on data models, source definitions, documentation, dataset ownership, and upstream dependencies.
- Create reusable tools and datasets that reduce recurring manual work and enable self-service data access.
- Participate in production support and incident response, restore data flow, reconcile affected datasets, and fix recurring failure causes.
Requirements
- Independently build and operate production data pipelines and related infrastructure.
- Strong SQL and Python skills, including testing, debugging, and maintainable software design.
- Experience with Snowflake or a comparable warehouse, including performance tuning and access management.
- Experience with workflow orchestration and transformation tools such as Airflow and dbt, or equivalent systems.
- Understanding of data modeling, incremental processing, schema evolution, and data-quality testing.
- Ability to trace data discrepancies from downstream reports to their sources, explain causes, and implement fixes.
- Ability to translate recurring stakeholder requests into reusable datasets or tooling and communicate trade-offs clearly.
- Helpful experience includes Kafka, database replication, change-data-capture systems, Apache Iceberg, Spark, Trino, infrastructure as code, data observability, lineage, disaster recovery, usage metering, billing and revenue data, or semantic layers for self-service analytics.
- Blockchain experience is not required.
Benefits
- Private health insurance.
- Gym reimbursement.
- Commuter benefits.
- Flexible time off.
- In-office group meals.
- Learning and development stipend.
- Company-sponsored conferences and events.
- Books and audiobook subscription with Bookster.
Tech Stack
Categories
Data Engineering