3 days ago
USA (city not specified) +3 moreMid Level
Base Salary
$50k - $999k/yr
Responsibilities
- Design and build scalable batch and streaming data platforms, selecting storage, compute, and processing based on latency, cost, and reliability needs.
- Own infrastructure for BigQuery, streaming systems, Dagster, Lightdash, environments, deployments, and platform automation.
- Implement access controls and governance, including IAM, policy tags, PII contracts, masked access paths, and audit logs.
- Provide ML platform capabilities including feature pipelines, training data, and real-time feature serving for fraud and risk models.
- Build platform tooling such as templates, CI checks, schema registries, data contracts, catalogs, and lineage systems.
- Monitor and improve platform reliability, latency, and cost, and respond to platform incidents and access requests.
- Design backend event and CDC flows into the warehouse and advise backend engineering teams on event design.
Requirements
- At least 4 years of experience building and running production data platforms on GCP, AWS, or Azure across both batch and streaming workloads.
- Experience designing data platforms at scale, including storage and compute choices, multi-team access, reliability, and cost management.
- Experience operating cloud data warehouses and real-time stores such as BigQuery and ClickHouse.
- Experience operating streaming infrastructure such as Pub/Sub, Kafka, Dataflow, or Flink, including retention, schema evolution, replay, and lag monitoring.
- Experience with batch infrastructure, orchestration using Dagster or Airflow, CI/CD, and deployment environments.
- Experience with infrastructure as code using Terraform.
- Experience with access control and data governance, including IAM, column- or row-level security, and PII handling.
- Strong Python and SQL skills.
- Proficiency with AI tools and responsibility for validating their output.
- Preferred experience with ML infrastructure such as feature stores, Vertex AI, or model serving.
- Preferred experience in regulated environments such as payments, banking, PCI, or SOC 2.
- Preferred experience with data catalogs, lineage tools, cost optimization, and CDC tools such as Datastream or Debezium.
Benefits
- Flexible time off with a required minimum of 10 vacation days.
- Flexible work arrangement with work-from-home, office, or hybrid options, plus a new-hire home workspace stipend.
- For US employees, Rain covers 95% of employee health, dental, and vision costs and 90% of dependent costs, plus company-subsidized life insurance.
- 401(k) with a 4% company match.
- Equity option plan for every employee.
- Monthly health and wellness stipend.
- Lunch and dinner for office-based employees through a DoorDash credit.
- Domestic and international team and company offsites.
Tech Stack
Apache AirflowApache FlinkApache KafkaAWSAzureClickHouseGoogle BigQueryGoogle Cloud PlatformPythonSnowflakeSQLTerraform
Categories
Data EngineeringDevOps
About Rain
Rain builds a card issuance and payments infrastructure platform for enterprises, fintechs, and platforms to use tokenized money in real-world transactions. Its services include compliant program management, digital-asset authorization and settlement, and rails that power stablecoin-backed cards, cross-border payouts, B2B purchases, and remittances. Founded in 2021, the privately held company partners with financial institutions and neobanks worldwide and is backed by investors such as ICONIQ, Lightspeed, Khosla, Galaxy, Sapphire, and Norwest.