G2i Inc.

Senior Python Engineer - LLM Code Evaluation

G2i Inc.
Apply
11 hours ago
Remote, WorldwideSenior

Responsibilities

  • Evaluate AI-generated coding interactions end-to-end.
  • Assess whether responses are useful, correct at a high level, well-reasoned, and aligned with strong engineering judgment.
  • Evaluate the quality of explanations, preambles, reasoning, and user guidance.
  • Distinguish between different levels of response quality and provide clear, opinionated feedback.
  • Help define what high-quality interactions look like for tools such as Cursor.

Requirements

  • Staff- or Principal-level engineering experience, or equivalent experience.
  • Strong background in TypeScript, JavaScript, or Python.
  • Hands-on experience using OpenAI Codex, Claude Code, and Cursor.
  • Deep familiarity with modern AI-assisted development workflows.
  • Ability to evaluate code without fully executing or deeply reviewing every line.
  • Comfort providing direct, opinionated feedback and making subjective but rigorous judgments.
  • High standards for engineering quality.
  • Preferred: experience with Cursor or similar AI-first IDEs, prompt design or evaluation workflows, mentoring senior engineers, or defining engineering standards.

Benefits

  • Contract engagement at approximately 10–20 hours per week.
  • Duration through early May, with possible extension.
  • Start ASAP.
  • Compensation of $100–$200 per hour.
  • Selection process includes a take-home evaluation exercise and one behavioral interview.
G2i Inc.

About G2i Inc.

201-500 employees

G2i Inc. is a privately held staffing marketplace that connects vetted software engineers—especially JavaScript, React, and React Native talent—with startups and enterprises for contract and full-time roles. Founded in 2016 and headquartered in Miami, it earns fees from contractor placements and direct hires, and also assembles teams for project-based work. Candidates can expect remote engagements with U.S. time-zone overlap and developer-focused screening.

Contact me