3 months ago
Base Salary
$180k - $250k/yr
Responsibilities
- Build internal tools for prompt management, evaluation, experimentation, and model iteration.
- Create systems for rapid testing, debugging, and comparison of model outputs.
- Develop infrastructure for benchmarking, regression testing, and monitoring AI system performance.
- Build pipelines and tooling for data collection, labeling, and feedback loops for model improvement.
- Partner with engineering teams to make AI features reliable, observable, and maintainable in production.
- Identify development bottlenecks and build systems that improve team productivity and confidence.
Requirements
- 3–7+ years of software engineering experience, ideally with developer tools, infrastructure, or platform teams.
- Strong proficiency in Python and experience building backend systems and internal tooling.
- Hands-on experience with LLMs, APIs such as OpenAI and Anthropic, and modern AI workflows.
- Experience building systems for experimentation, evaluation, or data pipelines.
- Strong systems thinking and the ability to design tools that scale across teams.
- Pragmatic, proactive, resourceful, and focused on developer velocity and real-world outcomes.
- Strong communication skills and the ability to collaborate with engineers, researchers, and product teams.
Tech Stack
Categories
About Crosby
Crosby operates an AI-enabled law firm that uses attorney-in-the-loop software to review and negotiate commercial contracts such as MSAs, DPAs, and NDAs for high-growth companies. It sells legal services delivered via proprietary tooling to speed deal close and standardize quality across workflows. Notable customers include Ramp, Cursor, and Cognition, and the company is privately held.