3 hours ago
Base Salary
$200k - $400k/yr
Responsibilities
- Design and implement high-throughput data pipelines and streaming systems with strong SLOs, runbooks, and actionable telemetry.
- Build and operate real-time and batch ingestion infrastructure using Kafka, Flink, and Airflow.
- Own the analytical data layer, including schema design, query performance, and cost optimization across ClickHouse, BigQuery, or similar systems.
- Partner with research and product teams to architect data solutions, evaluate performance, and scale new features.
- Optimize data paths, caching, partitioning, pipeline latency, and query latency to meet tight p95/p99 targets.
- Lead Terraform infrastructure-as-code and GitOps practices, including reusable modules and policy-as-code.
- Participate in on-call and reduce operational toil through automation and elimination of recurring data issues.
Requirements
- 5+ years of experience building and operating production data infrastructure at scale.
- Hands-on experience with Tier 1 data technologies including ClickHouse, Kafka or MSK/Pub-Sub/RabbitMQ, and Flink or dbt.
- Proven ability to meet high-availability and low-latency targets across streaming and batch workloads.
- Strong experience with OpenTelemetry, Prometheus/Grafana, or Datadog and disciplined incident response.
- Clear written communication and the ability to turn ambiguous data requirements into simple, reliable designs.
- Preferred: experience with Debezium and orchestration frameworks such as Airflow, Dagster, or Prefect.
- Preferred: familiarity with Spark or Dask for large-scale data processing.
- Preferred: experience with Snowflake, BigQuery, Redshift, or Databricks.
- Preferred: experience as an early data, platform, or infrastructure engineer.
- Preferred: strong Kubernetes experience with GKE, EKS, or AKS and exposure to GCP, AWS, and Azure.
- Preferred: experience with customer-managed deployments.
Benefits
- Medical, dental, vision, life insurance, disability, retirement, parental leave, and fertility and family-building benefits are offered to full-time employees.
- Monthly wellness and lifestyle stipend, daily office lunches and snacks, and a take-what-you-need vacation policy are provided.
- The role is in-office; benefits vary by location, and UK employees receive 25 days of statutory leave.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache KafkaApache SparkAWSAzureClickHouseDatabricksDatadogdbtGoogle BigQueryGoogle Cloud PlatformGrafanaKubernetesPrometheusRabbitMQSnowflakeTerraform
Categories
Data EngineeringDevOps
About Decagon
Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Chime, Oura Health, 1-800-FLOWERS.COM, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across voice, chat, email, SMS, and every other channel. We’re building a future where customer experiences are being redefined from support tickets and hold music to faster resolutions, richer conversations, and deeper relationships.