1 month ago
Base Salary
$247k - $339k/yr
Responsibilities
- Set technical direction and own the multi-year roadmap for data movement from production systems to analytical stores.
- Build CDC and streaming ingestion from CockroachDB changefeeds and MySQL binlogs through Kafka into Iceberg tables on S3.
- Handle ordering, deduplication, late data, schema changes, backfills, partitioning, compaction, catalogs, and table write strategies.
- Implement data contracts and quality checks across the platform using tools such as Anomalo and Monte Carlo.
- Own dataset SLAs, platform SLOs, on-call operations, incident reviews, and reliability follow-through.
- Operate Airflow and Fivetran and evaluate which capabilities to buy versus build.
- Lead migrations of existing pipelines and collaborate with senior engineers, data scientists, and analysts.
- Mentor engineers and improve the organization’s data engineering practices.
- Support data governance covering access control, PII, retention, deletion, lineage, and audit.
Requirements
- Experience building and operating data infrastructure used by other teams at meaningful scale and setting its technical direction.
- Deep experience with change data capture and streaming ingestion from operational databases through Kafka.
- Hands-on experience with lakehouse architectures and open table formats, especially Iceberg on S3.
- Strong Spark skills and experience running Databricks and Snowflake against shared storage.
- Experience with data quality, observability, data contracts, SLAs, and tools such as Anomalo or Monte Carlo.
- Experience operating Airflow at scale and working with managed ingestion such as Fivetran.
- Strong SQL and data modeling judgment for analyst and data scientist use cases.
- Strong Python plus at least one of Kotlin, Java, Scala, or Go.
- Experience shipping infrastructure on AWS with Terraform.
- Track record of leading cross-team data initiatives and migrations and mentoring senior engineers.
- Ability to explain technical tradeoffs to technical and leadership audiences and drive decisions.
- Willingness to take ownership of systems and participate in on-call operations.
- Experience in a marketplace, e-commerce, or transaction-heavy business is a plus.
Benefits
- Base salary range of $246,500 to $339,000 per year in San Francisco and New York, plus equity and benefits.
- Hybrid employees work from the office three days per week on Tuesdays, Thursdays, and one flexible Monday, Wednesday, or Friday; hybrid roles may work remotely up to four weeks per year.
- Competitive pay and comprehensive benefits.
- Equal employment opportunities and reasonable accommodations throughout the recruitment process.
Tech Stack
Amazon DynamoDBApache AirflowApache KafkaApache SparkAWSDatabricksGoJavaKotlinKubernetesMySQLPythonScalaSnowflakeSQLTerraform
Categories
Data Engineering
About Faire
Faire builds a B2B wholesale marketplace that connects independent retailers with consumer brands for product discovery, ordering, and net terms. It monetizes through marketplace commissions and financial services, and provides tools for payments, returns, and analytics to help shops source inventory. Founded in 2017 and headquartered in San Francisco, it operates across North America and Europe and is privately held.