1 day ago
Responsibilities
- Evaluate AI coding agents by assigning real software tickets, running their work, and reviewing the results.
- Work step by step with AI on real software engineering problems from familiar codebases.
- Identify where models make mistakes and provide feedback on model performance and quality standards.
- Collaborate directly with project leads and contribute to programs used by frontier AI labs.
Requirements
- At least 4 years of professional software engineering experience.
- Bachelor’s or master’s degree in computer science or a related field.
- US work authorization.
- Strong written English and availability for 40 hours per week during the contract.
- Ability to pass a proctored coding assessment without using AI tools.
- No prior AI background is required.
Benefits
- Fixed-pay contract of $6,000 per week for 40 hours, paid weekly.
- Work from anywhere on a self-directed schedule.
- Ongoing work available month after month rather than a short two-week engagement.
- The contract renews weekly while quality standards are met.
- Exceptional engineers may receive approval for additional hours paid at $150 per hour.
- Dedicated team support, fast answers, and feedback on work.
- Paid coding assessment and paid trial task.
Categories
About Handshake
Handshake builds a career network and recruiting platform that connects college students and recent grads with employers, sold as SaaS to universities and subscriptions/solutions to employers. Founded in 2014 and headquartered in San Francisco, it serves 1,600+ educational institutions and over 1 million employers. The company also operates Handshake AI, which partners with frontier AI labs on human data collection and evaluations for model training and post-training workflows.