11 days ago
Base Salary
$215k - $260k/yr
Responsibilities
- Own the end-to-end architecture of the Managed Data Transfer service, including the job API, scheduler, transfer workers, storage integration, and network paths.
- Evaluate the existing production prototype and lead its refactoring, extension, replacement, and customer migration without service disruption.
- Design data-plane strategies for sharding, concurrency, straggler handling, checksum verification, benchmarking, and line-rate transfers.
- Define and manage interfaces and schema contracts with Storage, Network, Kubernetes, IAM, Console, Billing, and Monitoring teams.
- Design extensibility for additional cloud providers and Crusoe-internal transfers using pluggable transfer engines and regional worker pools.
- Set reliability, observability, and on-call standards for the systems the team ships.
- Partner with Product on scope, pricing trade-offs, milestones, and early identification of edge cases.
- Lead architecture reviews and mentor engineers through design reviews, RFC feedback, and direct coaching.
Requirements
- 8+ years of experience shipping production software, including leading a service from prototype to general availability.
- Hands-on experience designing and operating data-intensive distributed systems at scale and understanding production failure modes.
- Understanding of object storage semantics, file systems, TCP throughput, and profiling and optimizing data transfers.
- Experience evolving live systems while minimizing risk to current customers.
- Experience defining API boundaries and schema contracts with partner teams and negotiating them to agreement.
- Experience with customer-facing on-call and building maintainable, observable, predictable systems.
- Proficiency in Go or another modern compiled language, with Go strongly preferred.
- Strong communication skills for explaining architectural decisions to engineers, product managers, and engineering managers.
- Preferred experience with bulk data transfer systems such as AWS DataSync, Google Storage Transfer Service, or rclone at petabyte scale.
- Preferred familiarity with cloud networking and interconnects such as AWS Direct Connect or GCP Interconnect.
- Preferred experience with cross-account cloud IAM and threat modeling for services holding customer credentials.
- Bonus experience with approximate nearest-neighbor indexing, including HNSW, IVF, product and scalar quantization, and DiskANN-style SSD indexes.
- Experience with AI, HPC, or Physical AI data pipelines is a bonus.
Benefits
- Competitive compensation, bonus, equity packages, and Restricted Stock Units.
- Paid time off, paid holidays, leave-of-absence programs, and paid parental leave.
- Comprehensive health, dental, and vision insurance plus employer HSA contributions.
- Paid life insurance and short- and long-term disability coverage.
- Professional development, tuition reimbursement, and mental health and wellness support.
- Commuter benefits, cell phone stipend, 401(k) plan with company match up to 4% of salary, and volunteer time off.
- Global travel insurance, emergency assistance, daily meals allowance, and location-specific perks.
Tech Stack
Categories
About Crusoe
Crusoe builds and operates GPU-powered data centers and an AI cloud platform for enterprises running large-scale AI training and inference. It vertically integrates energy supply with compute, using stranded and renewable power to reduce emissions and costs, and sells capacity via cloud services and managed infrastructure. Founded in 2018 and headquartered in Denver, the company is privately held.