about 11 hours ago
Base Salary
$200k - $400k/yr
Responsibilities
- Design and implement high-throughput data pipelines and streaming systems.
- Build and operate real-time and batch ingestion infrastructure using tools like Kafka and Flink.
- Own the analytical data layer, focusing on schema design and query performance.
- Partner with research and product teams to architect data solutions.
- Tune pipeline and query latencies to meet performance targets.
- Lead infrastructure-as-code practices for data systems.
- Participate in on-call duties and automate recurring data issues.
Requirements
- 5+ years of experience building and operating production data infrastructure.
- Hands-on experience with Tier 1 data technologies like ClickHouse and Kafka.
- Proven track record of meeting high availability and low latency targets.
- Excellent observability skills with tools like OpenTelemetry and Grafana.
- Strong written communication skills and ability to simplify complex data requirements.
Benefits
- Take what you need vacation policy.
- Medical, Dental, and Vision benefits for employees and their families.
- Life Insurance and Disability Benefits.
- Retirement Plan options like 401K.
- Parental Leave and fertility benefits.
- Daily lunches and snacks provided in the office.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache KafkaApache SparkAWSAzureClickHouseDatabricksDatadogGoogle BigQueryGoogle Cloud PlatformGrafanaKubernetesPrometheusSnowflakeTerraform
Categories
AI & MLData Engineering