about 3 hours ago
Remote, WorldwideStaff+
Responsibilities
- Ship the agent platform to production with essential features like event-triggered queues and durable state.
- Own the evaluation layer and implement a CI gate to ensure quality and safety of agents.
- Build and register a diverse portfolio of agents for various operational tasks.
- Enforce governance in code to ensure compliance and security across the platform.
- Design effective communication strategies for the system's interactions with users.
- Manage platform tooling and ensure integrity of the system's operations.
- Compute operating measures from production data to assess team performance.
- Instrument the platform to log and report its own value and performance.
Requirements
- Must have shipped production LLM agent systems with operational history.
- Experience in designing evaluations and behavioral assertions for AI systems.
- Deep API work experience and familiarity with MCP servers.
- Proficient in managing infrastructure end to end using Python on GCP.
- Strong understanding of how software interacts with users and manages notifications.
Benefits
- Fully remote work with a WeWork membership or co-working allowance.
- Equity ownership through ESOP for all team members.
- Tech allowance to set up an ideal work environment.
- 100% health insurance coverage for employees and 80% for dependents.
- Annual off-sites for team connection and collaboration.
- Flexible work hours with an emphasis on asynchronous operations.
- Annual education allowance for professional development.