2 months ago
Responsibilities
- Build and own high-throughput, traceable pipelines for frontier-scale data processing.
- Train and deploy high-throughput models that classify, rank, filter, clean, and identify training data.
- Design and run data-mixture, repeatability, and quality experiments tied to model performance.
- Build platforms, orchestration, tooling, and signals for transforming raw web, code, multimodal, and acquired data into training-ready datasets.
- Develop large-scale web crawling systems for URL discovery, scheduling, fetching, parsing, and document ingestion.
- Improve crawl coverage, host scheduling, antibot resilience, parsing quality, availability, recovery, and ingestion lag.
- Collaborate with data acquisition, data quality, data platform, and initial training teams.
Requirements
- Strong infrastructure or data platform background, with crawling or search infrastructure experience preferred but not required.
- Demonstrated ability to move quickly and take unusually deep ownership, potentially including staff-level ownership within a few years.
- Ability to architect and ship end-to-end systems, independently debug complex infrastructure, and work alongside AI agents.
- Strong understanding of large-scale distributed systems.
- Interest in how pretraining data shapes model quality and in building systems that support frontier training runs.
Tech Stack
HTML
Categories
Data EngineeringML Engineering
About Cursor
Cursor is an AI-powered code editor and coding assistant from Anysphere, built for professional software engineers and enterprise teams. It combines a VS Code–style editor with integrated AI chat, code generation, and repo-aware refactoring, and is sold via individual, team, and enterprise subscriptions. The company also targets sectors like healthcare and state and local education with field engineers who support evaluations and proofs of concept.