26 days ago
San Francisco, CA, USAMid Level / Senior
Base Salary
$200k - $400k/yr
Responsibilities
- Build, deploy, and operate production Spark data pipelines on Databricks.
- Partner with product teams to define pipeline requirements, data quality expectations, and freshness targets.
- Implement monitoring and observability for pipeline reliability.
- Diagnose and resolve pipeline performance, reliability, and cost problems at their root causes.
- Recommend pragmatic standards for operating pipelines as data and platform scale.
- Work as an individual contributor through ambiguity and collaborate directly with product teams.
Requirements
- Hands-on experience building, deploying, and maintaining production Spark pipelines.
- Strong understanding of performance, freshness, and cost tradeoffs involving clustering, shuffles, join strategies, and batch versus stream processing.
- Experience with reliability, monitoring, and observability, including diagnosing pipeline failures or bottlenecks.
- Strong SQL skills.
- Basic programming skills in any language; Python is a plus.
- Comfort working as an individual contributor and directly with product teams.
Benefits
- The role is based in San Francisco and requires working in the office five days per week.
- Opportunity to work on a high-autonomy team scaling an AI-native enterprise software platform.
- Opportunity to build new features from 0 to 1 and scale core systems.
Tech Stack
Categories
Data Engineering
About Monaco
Monaco builds an AI-native revenue platform that unifies core go-to-market tools—CRM, sequencing, enrichment, call recording, and pipeline management—into one system for B2B sales teams. The company sells its software by subscription, consolidating 6–10 separate tools into an integrated workflow for startups and growth-stage companies. Monaco is privately held and venture-backed by Benchmark, Founders Fund, and Human Capital.