3 months ago
USA (city not specified)Senior
Base Salary
$179k - $241k/yr
Responsibilities
- Design and implement multi-step agentic workflows covering routing, planning, tool use, and state management.
- Build evaluation frameworks, offline evaluations, production monitoring, and human-in-the-loop annotation processes.
- Develop context and retrieval pipelines over Crexi’s proprietary commercial real estate data.
- Build with Anthropic models on AWS Bedrock and use Bedrock AgentCore for runtime, identity, and memory while evaluating open-weight alternatives.
- Implement guardrails, structured outputs, ambiguity handling, and trace-level observability across LLM calls and tool invocations.
- Use agentic coding tools for scaffolding, refactoring, test generation, and debugging while reviewing generated output for correctness, security, and performance.
- Prototype against user feedback, collaborate with Product and Design, and turn successful prototypes into scalable reusable capabilities.
- Ensure AI outputs are explainable, source-linked, and trustworthy for business decisions.
Requirements
- 5+ years of professional software development experience in production environments with meaningful scope and ownership.
- 2+ years of hands-on experience building LLM-powered applications in production.
- Experience with agentic architectures including multi-step pipelines, tool or function calling, state machines, and memory.
- Strong retrieval design experience with RAG systems, embeddings, and vector search.
- Strong Python proficiency and production experience building backend services and APIs.
- Experience with cloud infrastructure, preferably AWS, and collaborative workflows using GitHub or GitLab, code reviews, and CI/CD.
- Professional use of agentic coding tools such as Claude Code or Codex.
- Experience designing LLM evaluation pipelines, including offline evaluations, production monitoring, or human-in-the-loop annotation, is preferred.
- Bachelor’s degree in Computer Science or a related field, or equivalent practical experience.
- Strong communication, analytical, organizational, prioritization, problem-solving, collaboration, initiative, and stakeholder-management skills.
Benefits
- Equity in Crexi’s growth story.
- Discretionary paid time off.
- Medical, dental, and vision insurance.
- 401(k), FSA/HSA options, and Life & AD&D insurance.
- Home-office reimbursement for remote employees.
- Collaborative culture with team activities.
- The posting references a Playa Vista, California location and notes that the salary range may differ for positions in other states.
Categories
About Crexi
Crexi builds a commercial real estate marketplace and SaaS platform used by brokers, investors, and owners to market listings, analyze comps, and manage deals. Its products include Crexi PRO for marketing and workflow, Crexi Intelligence for data and insights, and Crexi Auction for time-bound bidding; revenue comes from subscriptions and transaction fees. Founded in 2015 and headquartered in Los Angeles, the company is privately held.