GrepJob
Duckbill

Software Engineer, Platform

Duckbill
Apply
about 2 hours ago
San Francisco, CA, USAMid Level / Senior
H1B Sponsor

Base Salary

$200k - $250k/yr

Responsibilities

  • Own the data infrastructure for the Skyway platform.
  • Build and maintain streaming and batch data processing systems.
  • Develop the contract application engine to enrich and transform consumption data.
  • Design data models for multi-provider support and normalization.
  • Implement data validation systems to ensure quality control.
  • Optimize performance for heavy analytical workloads.
  • Collaborate with backend engineers and product teams on data contracts and APIs.

Requirements

  • Experience with data products, including warehouses, lakehouses, and ETL pipelines.
  • Proficiency in Python and SQL.
  • Familiarity with streaming and event-driven data as well as batch processing.
  • Strong understanding of data quality and validation.
  • Ability to adapt to evolving data schemas without a spec.
  • No specific domain expertise in cloud or AI billing is required.

Tech Stack

Apache AirflowAWSAzureClickHouseFlaskGoogle Cloud PlatformPythonReactSQL

Categories

AI & MLBackendData Engineering