4 months ago
Base Salary
$163k - $220k/yr
Responsibilities
- Ensure backwards compatibility and feature versioning across evolving schemas using Go and Python.
- Build scalable pipelines for ingesting, transforming, and serving petabytes of data.
- Create CI/CD workflows that align API changes with data schema updates.
- Enable fine-grained querying of historical and real-time data for networks.
- Define and enforce the principle of 'smart data, dumb functions' in the data layer.
- Collaborate with modelers to design reproducible and efficient training pipelines.
- Own performance across key endpoints to meet real-time serving constraints.
Requirements
- Proficiency in Go and Python programming languages.
- Experience with data processing technologies like Kafka, Postgres, and Clickhouse.
- Strong understanding of CI/CD workflows and API development.
- Ability to work collaboratively with cross-functional teams.
- Experience in building scalable data solutions and performance optimization.
Benefits
- Medical, dental & vision insurance coverage for you and your dependents.
- Annual memberships to One Medical, Headspace, and Wellhub.
- 401k with traditional and Roth options available.
- Flexible time off (FTO) policy.
- Commuter reimbursement.
- Parental leave.
- In-house chef and onsite meals at the San Francisco office.
Tech Stack
Categories
BackendData Engineering