2 months ago
Base Salary
$200k - $400k/yr
Responsibilities
- Design and implement high-throughput data pipelines and streaming systems with strong SLOs, runbooks, and actionable telemetry.
- Build and operate real-time and batch ingestion infrastructure using Kafka, Flink, and Airflow.
- Own the analytical data layer, including schema design, query performance, and cost optimization across ClickHouse, BigQuery, or similar systems.
- Partner with research and product teams to architect data solutions, evaluate performance, and scale new features.
- Optimize data paths, caching, partitioning, pipeline latency, and query latency to meet tight p95/p99 targets.
- Lead Terraform infrastructure-as-code and GitOps practices, including reusable modules and policy-as-code.
- Participate in on-call and reduce operational toil through automation and elimination of recurring data issues.
Requirements
- 5+ years of experience building and operating production data infrastructure at scale.
- Hands-on experience with Tier 1 data technologies including ClickHouse, Kafka or MSK/Pub-Sub/RabbitMQ, and Flink or dbt.
- Proven ability to meet high-availability and low-latency targets across streaming and batch workloads.
- Strong experience with OpenTelemetry, Prometheus/Grafana, or Datadog and disciplined incident response.
- Clear written communication and the ability to turn ambiguous data requirements into simple, reliable designs.
- Preferred: experience with Debezium and orchestration frameworks such as Airflow, Dagster, or Prefect.
- Preferred: familiarity with Spark or Dask for large-scale data processing.
- Preferred: experience with Snowflake, BigQuery, Redshift, or Databricks.
- Preferred: experience as an early data, platform, or infrastructure engineer.
- Preferred: strong Kubernetes experience with GKE, EKS, or AKS and exposure to GCP, AWS, and Azure.
- Preferred: experience with customer-managed deployments.
Benefits
- Medical, dental, vision, life insurance, disability, retirement, parental leave, and fertility and family-building benefits are offered to full-time employees.
- Monthly wellness and lifestyle stipend, daily office lunches and snacks, and a take-what-you-need vacation policy are provided.
- The role is in-office; benefits vary by location, and UK employees receive 25 days of statutory leave.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache KafkaApache SparkAWSAzureClickHouseDatabricksDatadogdbtGoogle BigQueryGoogle Cloud PlatformGrafanaKubernetesPrometheusRabbitMQSnowflakeTerraform
Categories
Data EngineeringDevOps
About Decagon
Decagon builds an enterprise conversational AI platform that deploys customer-support agents across voice, chat, email, SMS, and other channels. It sells to large brands via enterprise subscriptions and services, helping automate and personalize support workflows. Founded in 2023 and headquartered in San Francisco, Decagon’s customers include Avis Budget Group, Chime, Oura Health, and 1-800-Flowers.