Senior Data Engineer, Credential Data Pipelines
Recorded Future2 days ago
Base Salary
$129k - $194k/yr
Responsibilities
- Own and process the customer domain approval queue within the requester’s working day.
- Provision and backfill customer instances, including for live prospect evaluations.
- Triage data-correctness escalations by tracing customer-facing issues back to raw source logs.
- Build, release, and maintain infostealer, breach-dump, and combolist ingestion pipelines and shared platform libraries.
- Deliver the HIBP parity backlog and historical non-HIBP backlog in the reference index.
- Maintain routing parity on published dumps using corporate-domain and personal-domain rules.
- Administer API access for internal consumers such as research analysts.
Requirements
- Production experience building and operating ETL or data-ingestion pipelines, including parsing semi-structured and malformed source data.
- Working knowledge of Elasticsearch and AWS-hosted data services.
- Ability to debug end to end from a customer-facing UI or API symptom to the originating log record.
- Clear written communication with non-engineering stakeholders under time pressure.
- Familiarity with credential-exposure or threat-intelligence data is preferred.
- Experience owning an operational queue alongside a development backlog is preferred.
Benefits
- Full-time hybrid position.
- Base salary range of $129,000-$193,500, with potential eligibility for incentive compensation and equity.
- Medical, dental, vision, life insurance, and 401(k) benefits may be included.
- Final-round interviews require either an in-person interview or a live scheduled video conference with the hiring manager.
Tech Stack
AWSElasticsearch
Categories
Data Engineering
About Recorded Future
Recorded Future builds a threat intelligence platform that aggregates data from the open web, dark web, and technical sources to help security teams detect, analyze, and respond to cyber threats. It sells subscriptions to enterprises and government agencies, with modules for phishing, ransomware, third‑party risk, and state‑sponsored threats. Founded in 2009 and headquartered in Boston, it serves customers worldwide across regulated and high‑risk industries.