Software Engineer - Data Platform (Staff+)

22 days ago

San Francisco, CA, USA or New York, NY, USAStaff+

Base Salary

$100k - $300k/yr

Responsibilities

Build data connectors and ingestion systems for enterprise data sources.
Design and implement robust backend systems, ETL pipelines, and data extraction workflows.
Build highly performant data pipelines and indexing strategies for semantic search and retrieval-augmented generation.
Architect storage, query, indexing, and data lake strategies for enterprise data.
Collaborate with Applied AI teams to taxonomize, correlate, and deduplicate data.
Make build-versus-buy decisions for data-platform tools and services and integrate them into the broader architecture and technology roadmap.
Develop reusable system components and design patterns that scale from one integration to thousands.
Provide hands-on technical leadership across multiple platform projects.

5+ years of professional experience as a hands-on engineer and technical leader leading multiple projects.
Experience building enterprise information retrieval data pipelines, such as knowledge graphs or search engines.
Experience with ETL orchestration and workflow-management tools such as Temporal and Airflow.
Experience building batch-processing and streaming systems with Apache Kafka or Flink.
Expertise in database fundamentals, SQL, data reliability practices, and distributed computing.
Fluency with orchestration and deployment technologies including Kubernetes, Terraform, Docker, and Databricks across multiple clouds.

California applicants have a stated base salary range of $100,000-$300,000 annually.
Certain roles may be eligible for variable compensation, equity, and benefits.

51-200 employees