There are a lot of Eval frameworks, which work on the premise of and give a score to LLM response. They work pretty well with cases where we expect a response to a query, and a context(ground truth) is provided in form of RAG.
How can I use this paradigm for chatBot evaluation? Reason being that conversational bots also have chatHistory apart from the last Question in the chat, which doesn't seem to fit well in format. Or are there other ways to do evals ? How has been your experience testing/evaluating ?