1 month ago
Base Salary
$150k - $200k/yr
Responsibilities
- Lead technical customer onboarding to understand roles, hiring goals, required signals, and constraints.
- Translate customer needs into structured interview flows, role-specific question banks, scoring rubrics, thresholds, and interviewer behavior.
- Design, build, and refine prompts and agent logic for question sequencing, probing, candidate experience, edge cases, state management, and guardrails.
- Design and maintain AI-based evaluation and scoring systems aligned with customer rubrics and hiring criteria.
- Improve scoring accuracy, consistency, explainability, calibration, and fairness across roles and customers.
- Launch customer interviewers into production and own iteration from rollout through steady-state performance.
- Use customer feedback and production metrics to prioritize improvements and communicate changes to customers and internal stakeholders.
- Build and own lightweight QA and evaluation pipelines for conversation quality, scoring accuracy, and reliability.
- Monitor production performance and partner with engineering on quality, latency, and cost tradeoffs.
- Contribute standards and best practices for prompt quality, evaluation quality, and voice-agent reliability.
Requirements
- At least 2 years of engineering experience, with 4-6 years preferred.
- At least 1 year working with LLMs, NLP systems, or AI agents in production, with 2+ years preferred.
- Strong full-stack software engineering experience.
- Experience designing and deploying agent workflows using prompts and structured flows at scale.
- Strong understanding of prompt engineering, agent control, failure modes, and conversational edge cases.
- Experience building or contributing to evaluation, testing, or QA frameworks for AI systems.
- Comfort with customer-facing technical discovery, requirements translation, and onboarding through production.
- Strong analytical skills involving accuracy, consistency, bias, calibration, and edge cases.
- Experience as a Forward Deployed Engineer at a B2B AI technology company is preferred.
- Familiarity with voice or conversational AI systems, especially real-time or high-volume environments, is preferred.
- Strong Python skills involving APIs, data pipelines, evaluation harnesses, and testing frameworks are preferred.
- Hands-on experience with multiple LLMs, including GPT, Claude, Gemini, LLaMA, Mistral, or fine-tuned models, is preferred.
- Experience designing multi-step agents with state management and structured outputs is preferred.
- Experience operating AI systems in production and iterating based on performance metrics is preferred.
- Prior startup experience is preferred.
- Bachelor’s degree in computer science, engineering, mathematics, or a related technical field, or equivalent practical experience.
Benefits
- Hybrid work arrangement in NYC with in-office work Monday through Thursday
- Meaningful equity
- Opportunity to shape the product and career trajectory
Tech Stack
Categories
Forward Deployed
About Take2
Healthcare recruiting has never been harder. Endless open roles. Scarce qualified candidates. Recruiters buried in manual work, trying to keep pace. Take2 removes that bottleneck. Our autonomous AI agents source, screen, schedule, vet, and collect references 24/7 – so your team stops chasing and starts deciding. Take2 integrates with every major ATS and HRIS, so your team gets the data they need in the platforms they already use. Our clients see 70% recruiter time reclaimed from screening. 2x faster time-to-hire. 4.8/5 candidate experience. Better hiring outcomes and retention. See Take2 in action: take2.ai/demo