27 days ago
Remote, United StatesSenior
Responsibilities
- Own agent development from initial scope through conversation design, tooling, evaluation, launch, and continuous production iteration.
- Design and build conversational AI agents on the Sierra platform using prompts, procedural knowledge, deterministic guardrails, and conversational flows.
- Integrate agents with policy administration, quoting, and claims systems through APIs, authentication patterns, and service accounts.
- Build release snapshots, monitoring, logging, error handling, automated tests, regression coverage, reconciliation checks, and anomaly detection.
- Establish quality assurance processes by auditing conversations, annotating behavior, and converting findings into regression tests.
- Monitor production performance, respond to incidents, participate in on-call support, and improve agent reliability and outcomes.
- Advise on AI agent strategy, identify new use cases, and contribute reusable integration patterns and secure-by-default engineering standards.
Requirements
- Hands-on experience building or deploying AI or LLM agents in production, including prompt engineering, evaluation frameworks, RAG, and agent tooling.
- Strong technical aptitude, including reading API documentation, understanding data models and system architecture, and evaluating engineering tradeoffs.
- Experience with low-code, no-code, or declarative platforms and the ability to learn new tooling quickly.
- Experience consuming and integrating APIs, including authentication patterns and service accounts.
- Experience applying automated testing, regression coverage, monitoring, and alerting to low-code or no-code development.
- Experience with CI/CD, release management, deployment promotion across development, test, and production environments, versioning, and rollback practices.
- Knowledge of least-privilege access, secrets management, auditability, and compliant handling of sensitive member data.
- Proven ability to own complex, high-visibility projects from scoping and stakeholder alignment through production launch and continuous improvement.
- Strong written and verbal communication, analytical ability, problem-solving skills, and experience delivering measurable outcomes at the intersection of technology and business operations.
- A degree in Computer Science, Engineering, Mathematics, or a related technical field, or equivalent practical or comparable experience at the intersection of technology and business.
- Preferred experience includes insurance or financial services, telephony and voice agents, conversational design, customer experience, contact center operations, and public company or Sarbanes-Oxley requirements.
Benefits
- Open to U.S. remote work.
- Employees within 20 miles of the Traverse City headquarters work a hybrid schedule of three office days per week.
- May require travel for quarterly events.
- Comprehensive benefits and company perks are available; compensation and benefits details vary by jurisdiction.
