2 days ago
Base Salary
$112k - $176k/yr
Responsibilities
- Build and operate Kotlin and Apache Beam pipelines on Google Cloud Dataflow for streaming and batch ingestion from Kafka and cloud storage into Apache Iceberg tables.
- Maintain large Iceberg tables through partitioning, Spark-based compaction, deduplication, snapshot expiry, orphan-file cleanup, and source reconciliation.
- Expose datasets through BigQuery, Snowflake, and Starburst/Trino using Iceberg catalogs and stable consumer views.
- Collaborate with producer teams on schemas and data contracts and simplify and document new dataset publishing.
- Build Datadog dashboards and monitors for data freshness, completeness, and budget compliance, with future AI-assisted alert triage.
- Own production pipelines end to end, including incident response and corrective fixes.
- Deliver code through review, staged releases, and unit, integration, and end-to-end testing while managing infrastructure with Terraform across GCP and AWS.
- Work with data consumers, producer teams, and platform teams while contributing to the technical roadmap.
Requirements
- At least 3 years of professional software engineering experience focused on data engineering or distributed systems.
- Strong programming ability in Kotlin, Java, or Python, with willingness to work across Kotlin ingestion pipelines and Python maintenance and orchestration.
- Hands-on experience with Apache Beam, preferably on Google Cloud Dataflow, or Apache Spark.
- Production experience with Apache Kafka or a similar streaming platform and very large distributed datasets.
- Understanding of lakehouse architecture, open table formats, and preferably Apache Iceberg.
- Strong SQL skills and working knowledge of BigQuery, Snowflake, or Starburst/Trino.
- Experience with Protobuf or Avro schemas, schema evolution, GCP or AWS, and production pipeline observability.
- Experience with unit, integration, and end-to-end testing, metrics, dashboards, alerts, and end-to-end ownership of production incidents.
- Practical use of AI coding assistants such as Claude Code or Codex, with the ability to review and test generated code.
- Cross-team collaboration experience with producer, consumer, analytics, ML, and platform or infrastructure teams.
- Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
- Preferred qualifications include production Apache Iceberg experience, metadata catalogs and governance tooling, AI agents for pipeline monitoring, multi-cloud data infrastructure, data contract negotiation, technical strategy, Terraform, Apache Airflow, Cloud Composer, or dbt.
Benefits
- Hybrid work arrangement.
- Comprehensive benefits and holistic mind, body, and lifestyle programs for employees and their families.
- US base salary range of $112,000—$176,000, with potential additional bonus, commission, equity, and other benefits.
Tech Stack
Apache AirflowApache BeamApache KafkaApache SparkAWSDatadogdbtGoogle BigQueryGoogle CloudGoogle Cloud PlatformJavaKotlinPythonSnowflakeSQLTerraform
Categories
Data Engineering
About ZoomInfo
ZoomInfo builds a subscription go-to-market platform for B2B sales and marketing teams, combining company and contact data, intent signals, and sales engagement tools. Its products help organizations find prospects, align GTM motions, and automate outreach, and are used by more than 35,000 companies. The public company (NASDAQ: GTM; also traded in Frankfurt) is headquartered in Vancouver, Washington, and grew out of DiscoverOrg’s acquisition of ZoomInfo.