8 days ago
Remote, India or Remote, EMEASenior
Responsibilities
- Architect, develop, and deploy production-grade LLM capabilities within the Kayzen Console.
- Build backend services, APIs, and integrations connecting AI capabilities with the product.
- Contribute to product-facing and full-stack functionality as needed.
- Implement production patterns for LLMs, RAG, embeddings, agents, and tool calling.
- Build reusable components and abstractions that improve engineering velocity and consistency.
- Set up and improve evaluation, observability, monitoring, and feedback loops for AI features.
- Monitor and optimize AI quality, latency, reliability, and inference cost.
- Troubleshoot production issues and iterate based on telemetry and user feedback.
- Collaborate with Product, ML, and Engineering to translate product problems into pragmatic AI solutions.
- Prototype quickly and turn successful experiments into maintainable production systems.
Requirements
- Hands-on experience building and shipping LLM-powered features to production.
- Practical experience with RAG, embeddings, vector search, and/or agentic systems.
- Experience with LLM APIs and orchestration patterns.
- Understanding of production LLM concerns including evaluation, observability, failure modes, cost, and latency.
- Experience iterating on AI features using telemetry, evaluation results, or user feedback.
- Strong experience designing APIs, services, and production-grade systems.
- Experience with full-stack product development using Angular, JavaScript/TypeScript, Python, and NodeJS is a strong plus.
- Ability to write clean, maintainable code and own work from implementation through production.
- Experience contributing across a product stack and willingness to work on backend systems and user-facing functionality.
- Comfort working with AWS cloud infrastructure and production environments.
- Experience with multi-agent systems, tool calling, or MCP is a plus.
- Experience with guardrails, moderation, safety checks, prompt and context management, routing, caching, or fallback strategies is a plus.
- Experience with Docker, AWS, GCP, or Azure is a plus.
- Experience with modern frontend development and customer-facing web applications is a plus.
Benefits
- Direct access to top management and a highly visible role.
- Exceptional career growth and learning opportunities.
- Opportunity to work with an experienced multinational team in the Adtech market.
- Flexible work-from-home arrangement.
- 500-dollar home-office setup budget.
- 1000-dollar annual learning and development budget.
- Visa and relocation support if required.
