Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)
G2i Inc.Responsibilities
- Evaluate AI-generated coding interactions end-to-end.
- Assess whether responses, preambles, reasoning, explanations, and outputs are useful, correct at a high level, and aligned with strong engineering practice.
- Distinguish among different levels of response quality and define what makes an interaction excellent.
- Provide clear feedback about what worked, what failed, and what felt misleading or inappropriate.
- Help define quality standards for interactions with tools such as Cursor.
- Make subjective but rigorous judgments about whether an interaction feels like something a strong engineer would say.
Requirements
- Staff- or Principal-level software engineer, or equivalent experience.
- Strong background in TypeScript, JavaScript, or Python.
- Hands-on experience with OpenAI Codex, Claude Code, and Cursor.
- Deep familiarity with modern AI-assisted development workflows.
- Ability to evaluate code without fully executing it or deeply reviewing every line.
- Comfort providing direct, opinionated, and rigorous feedback.
- High standards for engineering quality and judgment.
- Experience with prompt design, evaluation workflows, AI-first IDEs, mentoring senior engineers, or defining engineering standards is preferred.
Benefits
- Contract engagement at approximately 10–20 hours per week
- Engagement starts ASAP and runs through early May, with possible extension
- Hourly rate of $100–$200
Tech Stack
About G2i Inc.
G2I is an AI engineering company that helps the world's leading frontier labs, enterprises, and high-growth startups hire, train, and ship AI systems. Fast. We do three things really well: placing senior engineering talent on demand, building the human workflows and evaluation systems that train and improve AI models, and leading end-to-end product builds for complex engineering challenges. We stay accountable beyond placement, from onboarding and activation through to delivery and retention. That's why our clients tend to see us less as a vendor, and more as a partner in building. 𝗴𝟮𝗶.𝗰𝗼: AI talent on demand. Senior engineers matched and ready in days. 𝗴𝟮𝗶.𝗮𝗶: Engineering expertise powering AI training. We build the environments, rubrics, and human workflows that turn reasoning into structured training data. 𝗼𝗿𝗰.𝗮𝗶: Multi-agent orchestration for complex engineering. Ship code that's scalable, maintainable, tested, and secure. 10 years in. 8,000+ vetted engineers. Clients include Meta, Google, Microsoft, Webflow, Coinbase, 1Password, and the world's leading frontier labs. We also built and run React Miami and AI Engineer Miami, two of the most respected developer conferences in the US. G2I is headquartered in Miami, FL. Learn more at g2i.co, g2i.ai, and orc.ai.