24 days ago
Remote, AmericasSenior
Responsibilities
- Evaluate AI-generated coding interactions from start to finish.
- Judge whether outputs are useful, correct at a high level, and consistent with strong engineering judgment.
- Assess the quality of explanations, reasoning, preambles, and guidance provided by coding agents.
- Distinguish different levels of response quality and help define what excellent performance looks like.
- Provide direct, opinionated written feedback and record short video explanations.
- Evaluate tools and workflows involving OpenAI Codex, Claude Code, and Cursor without necessarily executing the code or reviewing every line.
Requirements
- Senior, Staff, or Principal-level software engineering experience, or equivalent experience.
- Strong background in TypeScript, JavaScript, or Python.
- Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.
- Deep familiarity with modern AI-assisted development workflows.
- Ability to evaluate code without executing it or reviewing every line.
- Strong written and spoken English at B2 level or above.
- Comfort giving direct, opinionated feedback and making rigorous subjective judgments.
- High standards for engineering quality.
- Prior prompt design or evaluation workflow experience is preferred.
- Experience mentoring senior engineers or defining engineering standards is preferred.
Benefits
- Worldwide remote contract engagement.
- Compensation of $100–$200 per hour depending on experience and location.
- Flexible schedule of 10–20 hours per week.
- Ongoing work, with individual projects lasting approximately two weeks to a few months.
- New projects may be offered to evaluators who perform well.
- Start as soon as the take-home evaluation is cleared and a project seat is available.
- Selection process consists of one take-home evaluation exercise with a recorded Loom walkthrough and no interview.
Tech Stack
Categories
About G2i Inc.
G2i Inc. is a privately held staffing marketplace that connects vetted software engineers—especially JavaScript, React, and React Native talent—with startups and enterprises for contract and full-time roles. Founded in 2016 and headquartered in Miami, it earns fees from contractor placements and direct hires, and also assembles teams for project-based work. Candidates can expect remote engagements with U.S. time-zone overlap and developer-focused screening.