Staff Software Engineer, Data Infrastructure

3 days ago

Base Salary

$200k - $275k/yr

Responsibilities

Design and operate a high-throughput, real-time data integration platform across diverse customer environments.
Architect a scalable open table format layer for reliable petabyte-scale data storage.
Build and optimize distributed batch and streaming data processing pipelines.
Drive performance, reliability, and cost efficiency across the data infrastructure stack.
Collaborate with platform and product engineering teams on data contracts, schemas, and integration patterns.
Establish tooling, best practices, and patterns that improve data infrastructure quality across the organization.

8+ years of experience architecting and operating large-scale data infrastructure systems in production.
Deep expertise with Apache Iceberg, including schema evolution, partitioning, compaction, and time travel.
Extensive hands-on experience with Apache Spark for batch and streaming processing at scale.
Strong real-time data integration and stream processing experience with Apache Kafka, Apache Flink, or equivalent technologies.
Experience with data pipeline orchestration using Airflow or similar tools.
Strong software engineering fundamentals in Python and/or Scala with production-quality coding experience.
Extensive experience with AWS or comparable cloud platforms, including S3-based data lake architectures.
Experience with Kubernetes and containerized deployment of data workloads.
Degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Located in San Francisco, New York, or Washington DC and open to working in an office.

Benefits, equity if applicable, and bonus if applicable are offered.
The role requires working in an office and is based in San Francisco, New York, or Washington DC.

501-1,000 employees