2 months ago
Remote, CanadaSenior
Responsibilities
- Translate business processes, judgment, and edge cases into reusable agent skills.
- Connect agents to systems of record through MCP servers and build additional MCP integrations when needed.
- Define correctness criteria, create evaluation sets, establish baselines, and use evaluations to determine what ships.
- Deploy, monitor, tune, document, and support agents in production with permissions, human-in-the-loop checkpoints, audit trails, and rollback procedures.
- Partner with business teams to understand operational workflows and with data engineers on data access, models, and quality.
Requirements
- Substantial hands-on experience shipping LLM-backed applications using prompting, tool use, agentic loops, and multi-step workflows.
- Experience shipping at least one agent relied upon by non-engineers.
- Practical experience with MCP, skill or tool authoring, and agent orchestration against real systems of record.
- Experience building evaluation sets and using them to make engineering decisions.
- Fluency with Python and comfort with SQL and production data models.
- Experience using agentic coding tools such as Cursor.
- Experience with Git, CI, containers, and deploying and operating software.
- Ability to translate non-technical operators' processes into requirements independently.
- At least 5 years of hands-on software development experience.
- Bonus: experience maintaining MCP servers; solutions engineering, professional services, internal tools, or startup founding experience; familiarity with Linear, Jira, Zendesk, Salesforce, or Snowflake; and regulated-domain experience.
Benefits
- Remote-first work arrangement.
- 100% medical, dental, and vision coverage.
- Flexible PTO.
- Annual home office stipend and WeWork access.
- Mental and physical health wellness programs, including Headspace and Lumino.
- Competitive compensation and opportunity for advancement.
Categories
AI ApplicationsForward Deployed
About Coalition
Coalition builds cyber insurance and active risk management for businesses, combining coverage with cybersecurity tools, automated alerts, and MDR. It distributes policies in the U.S., U.K., Canada, and Australia through partner insurers and its own carrier, Coalition Insurance Company, and provides its Coalition Control cyber risk platform. Founded in 2017 and headquartered in San Francisco, the company is privately held.