19 days ago
Dublin, Ireland or London, United KingdomSenior
Responsibilities
- Design and ship production AI agent systems, including the data access layer, retrieval strategy, and integrations with Metabase and internal APIs.
- Build and own an evaluation framework with golden datasets, regression harnesses, and retrieval-versus-generation failure analysis.
- Address prompt injection, data boundary violations, and silent failure modes in a regulated environment.
- Set technical direction for AI architecture and identify opportunities to apply AI across Kota’s products.
- Collaborate with the AI Product Lead and Platform team, contribute to peer review and documentation, and help shape the expanding AI pod.
Requirements
- 5+ years of software engineering experience, including at least 2 years working directly on LLM or AI agent systems in production.
- Strong understanding of agent architecture, context management, tool use, retrieval strategies, and prompt design.
- Experience building evaluation frameworks with golden datasets, regression testing, and retrieval-versus-generation failure analysis.
- Comfort working across the stack and communicating technical decisions clearly to non-technical stakeholders.
- Preferred: experience in fintech, payroll, HR technology, benefits, AWS, Azure, the Microsoft ecosystem, synthetic evaluation data, or early-stage and scale-up environments.
Benefits
- Remote-first, full-time permanent role with collaboration within approximately 4 hours of GMT.
- Health insurance via Kota.
- Workplace pension with matched contributions up to 5%, country dependent.
- Work-from-home stipend.
- 25 days of paid time off.
- Annual company-wide and dedicated team offsites.
- Attractive stock options.
Categories
