9 hours ago
Remote, United StatesMid Level / Senior
Responsibilities
- Build and operate production web scrapers, third-party integrations, and data pipelines.
- Design systems for schema changes, rate limits, authentication requirements, and partial failures.
- Build retry, backfill, deduplication, idempotency, and replay mechanisms.
- Define and monitor data completeness, correctness, freshness, duplication, and provenance.
- Develop APIs, databases, and shared services for collection workflows.
- Partner with mission teams, platform teams, and product managers on data sources and requirements.
- Influence architecture, technology selection, and engineering standards for collection systems.
Requirements
- 4+ years of backend engineering experience, including production web scraping, data ingestion, ETL, or third-party integrations.
- Production Python experience and familiarity with relational databases and API design.
- Experience maintaining data quality across large, changing datasets.
- Experience designing systems that tolerate upstream failures and changing external interfaces.
- Ability to make tradeoffs among reliability, scalability, performance, maintainability, and cost.
- Clear technical communication and effective cross-functional collaboration.
- U.S. Person status and ability to obtain a security clearance.
Benefits
- Health, dental, and vision insurance.
- Remote-friendly work arrangement with WeWork access.
- Unlimited PTO, shared downtime during the federal holiday calendar, and company-wide time off at year-end.
- 401(k) match.
- Lifestyle and wellbeing stipends.
- Salary top-up during military reserve duty.
- Fully paid parental leave.
- Child and pet care reimbursement during travel.
About Vannevar
Vannevar Labs builds AI-driven mission software for U.S. defense, intelligence, and national security agencies, used for targeting, planning, and decision support. It sells government-focused software products powered by large adversarial data sets, including an agentic AI platform that models adversary behavior and recommends courses of action. The privately held company is headquartered in Palo Alto, California, with deployments across U.S. government programs.